2023-11-24T07:39:57.278 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T07:39:57.278 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573 --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/orig.config.yaml 2023-11-24T07:39:57.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:39:57.422 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} email: null first_in_suite: false job_id: '7465573' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-tests sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9764 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-tests suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLk25BrYH4aQahsIF9eRisRqqxeyQXg8VD0LKT7euYG+DBina54QY7n6YjIO4Eeu6Go1a6VzbLED3+HUxruhOtY= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRw3/2AEIHJrlQoY1v1avzQ5H0ybWQyPKnF8iK3xe+K/iVs+bqRajUC2gVaUzdjwhhWuLNDumtZgkxeiT7YbY8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_07:31:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T07:39:57.423 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa; will attempt to use it 2023-11-24T07:39:57.423 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks 2023-11-24T07:39:57.423 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T07:39:57.425 INFO:teuthology.task.internal:Checking packages... 2023-11-24T07:39:57.454 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T07:39:57.455 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T07:39:57.455 INFO:teuthology.packaging:ref: None 2023-11-24T07:39:57.455 INFO:teuthology.packaging:tag: None 2023-11-24T07:39:57.455 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T07:39:57.455 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:39:57.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T07:39:57.684 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:39:57.684 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T07:39:57.690 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T07:39:57.691 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T07:39:57.765 INFO:teuthology.task.internal:Saving configuration 2023-11-24T07:39:57.782 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T07:39:57.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:39:57.813 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:34:22.809863', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMwbJ3KVYWM/rsY0poGw6xHqYnlWlfXWOMSjq9lHHu63'} 2023-11-24T07:39:57.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:34:22.807986', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDA7udNO9TvyexV5ZSWUvvjJUCy1V1VVkjd7xsdOGDmT'} 2023-11-24T07:39:57.838 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T07:39:57.843 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T07:39:57.843 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T07:39:57.844 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T07:39:57.924 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f852eed8ee0>, signals=[15]) 2023-11-24T07:39:57.925 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T07:39:57.931 INFO:teuthology.task.internal:Opening connections... 2023-11-24T07:39:57.931 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:39:57.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:39:58.009 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:39:58.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:39:58.087 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T07:39:58.093 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-11-24T07:39:58.099 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-11-24T07:39:58.099 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2023-11-24T07:39:58.154 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T07:39:58.155 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T07:39:58.155 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T07:39:58.155 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T07:39:58.155 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2023-11-24T07:39:58.156 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-11-24T07:39:58.182 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-11-24T07:39:58.187 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-11-24T07:39:58.188 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-11-24T07:39:58.236 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T07:39:58.236 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-11-24T07:39:58.236 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2023-11-24T07:39:58.236 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T07:39:58.237 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2023-11-24T07:39:58.237 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-11-24T07:39:58.257 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T07:39:58.267 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T07:39:58.288 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T07:39:58.288 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:39:58.291 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:39:58.295 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T07:39:58.351 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T07:39:58.351 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:39:58.354 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:39:58.363 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T07:39:58.417 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T07:39:58.432 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T07:39:58.433 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-24T07:39:58.433 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-24T07:39:58.433 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:39:58.434 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:39:58.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:39:58.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T07:39:58.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:39:58.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T07:39:58.649 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:39:58.650 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:39:58.650 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-11-24T07:39:58.655 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-56-generic 2023-11-24T07:39:58.656 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:39:58.656 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:39:58.656 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-24T07:39:58.656 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T07:39:58.714 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T07:39:58.729 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:39:58.729 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:39:58.729 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-11-24T07:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2023-11-24T07:39:58.735 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:39:58.736 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:39:58.736 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-24T07:39:58.736 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T07:39:58.792 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T07:39:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T07:39:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T07:39:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git config --global init.defaultBranch 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T07:39:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-11-24T07:39:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git branch -m 2023-11-24T07:39:58.835 INFO:teuthology.orchestra.run.smithi005.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T07:39:58.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T07:39:58.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T07:39:58.966 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git config --global init.defaultBranch 2023-11-24T07:39:58.992 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-24T07:39:58.993 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T07:39:58.993 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T07:39:58.993 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-24T07:39:58.993 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git branch -m 2023-11-24T07:39:58.994 INFO:teuthology.orchestra.run.smithi102.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T07:39:58.996 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T07:39:59.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T07:39:59.119 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T07:41:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T07:41:23.580 INFO:teuthology.orchestra.run.smithi102.stderr: * [new branch] main -> origin/main 2023-11-24T07:41:23.603 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T07:41:23.603 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T07:41:23.603 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T07:41:23.603 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T07:41:23.603 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T07:41:23.604 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T07:41:23.604 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T07:41:23.604 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T07:41:23.604 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T07:41:23.606 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T07:41:23.606 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T07:41:23.606 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T07:41:23.606 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T07:41:23.606 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T07:41:23.607 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T07:41:23.608 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T07:41:23.608 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T07:41:23.608 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T07:41:23.608 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T07:41:23.610 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T07:41:23.611 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T07:41:27.587 INFO:teuthology.orchestra.run.smithi102.stderr:Updating files: 51% (1665/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2648/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T07:41:27.592 INFO:teuthology.orchestra.run.smithi102.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T07:41:27.612 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T07:41:27.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:41:27.766 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T07:41:27.766 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T07:41:27.769 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi102.front.sepia.ceph.com to complete... 2023-11-24T07:41:29.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24 07:41:29 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T07:41:29.523 INFO:teuthology.orchestra.run.smithi102.stderr:FINISHED --2023-11-24 07:41:29-- 2023-11-24T07:41:29.523 INFO:teuthology.orchestra.run.smithi102.stderr:Total wall clock time: 1.7s 2023-11-24T07:41:29.523 INFO:teuthology.orchestra.run.smithi102.stderr:Downloaded: 1 files, 37M in 1.5s (25.5 MB/s) 2023-11-24T07:41:29.526 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T07:41:29.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T07:41:29.757 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T07:41:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T07:41:31.309 INFO:teuthology.orchestra.run.smithi005.stderr: * [new branch] main -> origin/main 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T07:41:31.341 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T07:41:31.342 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T07:41:31.342 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T07:41:31.344 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T07:41:31.345 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T07:41:31.347 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T07:41:31.348 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T07:41:31.349 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T07:41:31.349 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T07:41:31.349 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T07:41:31.790 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T07:41:31.794 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T07:41:31.902 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:41:34.909 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:41:35.020 INFO:teuthology.orchestra.run.smithi102.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:41:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:Updating files: 48% (1588/3248) Updating files: 49% (1592/3248) Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 63% (2072/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 79% (2577/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 85% (2763/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T07:41:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T07:41:35.591 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T07:41:35.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:41:35.834 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T07:41:35.835 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T07:41:35.837 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2023-11-24T07:41:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24 07:41:38 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T07:41:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2023-11-24 07:41:38-- 2023-11-24T07:41:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 1.5s 2023-11-24T07:41:37.333 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2023-11-24T07:41:37.335 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T07:41:37.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T07:41:37.590 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T07:41:39.553 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T07:41:39.557 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T07:41:39.666 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:41:43.275 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:41:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:41:55.016 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:41:55.024 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:41:55.047 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-11-24T07:41:55.349 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:41:55.368 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:41:55.637 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:41:55.643 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:41:55.701 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:41:55.707 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:41:55.865 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:41:55.866 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:41:55.866 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:41:55.918 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-11-24T07:41:56.101 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T07:41:56.109 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T07:41:56.110 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T07:41:56.110 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:41:56.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:41:56.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:41:56.146 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T07:41:56.147 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T07:41:56.147 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T07:41:56.147 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T07:41:56.147 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T07:41:56.148 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T07:41:56.148 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T07:41:56.148 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T07:41:56.148 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T07:41:56.148 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:41:56.149 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:41:56.150 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:41:56.151 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:41:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T07:41:56.153 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T07:41:56.153 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T07:41:56.153 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:41:56.153 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T07:41:56.153 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T07:41:56.154 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T07:41:56.154 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:41:56.154 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:41:56.235 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:41:56.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:41:56.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:41:56.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:41:56.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:41:56.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:41:56.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:41:56.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:41:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:41:56.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:41:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:41:56.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T07:41:56.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T07:41:56.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T07:41:56.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:41:56.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:41:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T07:41:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T07:41:56.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T07:41:56.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:41:56.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:41:56.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T07:41:56.254 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T07:41:56.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T07:41:56.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T07:41:56.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:41:56.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:41:56.258 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T07:41:56.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:41:56.259 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T07:41:56.259 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T07:41:56.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:41:56.259 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:41:56.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:41:56.261 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T07:41:56.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T07:41:56.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T07:41:56.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T07:41:56.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T07:41:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:41:56.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:41:56.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:41:56.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:41:56.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:41:56.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T07:41:56.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:41:56.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:41:56.270 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:41:56.270 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:41:56.270 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:41:56.270 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T07:41:56.270 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T07:41:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:41:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:41:56.273 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:41:56.274 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:41:56.274 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:41:56.274 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:41:56.274 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:41:56.274 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:41:56.275 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:41:56.276 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T07:41:56.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:41:56.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:41:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T07:41:56.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:41:56.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:41:56.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:41:56.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:41:56.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:41:56.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:41:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:41:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:41:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:41:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:41:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:41:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:41:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T07:41:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:41:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:41:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T07:41:56.296 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T07:41:56.297 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:41:56.298 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T07:41:56.299 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:41:56.300 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T07:41:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T07:41:56.302 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T07:41:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T07:41:56.304 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:41:56.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:41:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T07:41:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:41:56.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:41:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T07:41:56.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:41:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T07:41:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T07:41:56.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:41:56.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:41:56.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:41:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:41:56.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T07:41:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T07:41:56.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T07:41:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T07:41:56.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:41:56.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T07:41:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T07:41:56.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:41:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:41:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T07:41:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T07:41:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:41:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:41:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:41:56.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T07:41:56.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:41:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T07:41:56.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T07:41:56.336 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T07:41:56.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T07:41:56.338 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T07:41:56.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T07:41:56.340 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T07:41:56.341 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:41:56.341 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T07:41:56.341 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T07:41:56.341 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:41:56.341 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T07:41:56.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T07:41:56.343 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T07:41:56.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:41:56.344 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T07:41:56.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:41:56.344 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T07:41:56.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T07:41:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T07:41:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:41:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T07:41:56.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:41:56.460 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T07:41:56.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:41:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:41:56.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T07:41:56.464 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:41:56.465 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T07:41:56.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:41:56.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:41:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T07:41:56.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:41:56.471 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:41:56.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T07:41:56.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T07:41:56.474 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T07:41:56.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:41:56.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:41:56.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T07:41:56.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T07:41:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T07:41:56.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:41:56.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T07:41:56.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:41:56.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T07:41:56.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:41:56.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T07:41:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:41:56.487 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T07:41:56.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:41:56.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:41:56.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:41:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:41:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:41:56.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T07:41:56.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:41:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:41:56.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T07:41:56.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:41:56.498 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:41:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:41:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T07:41:56.501 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T07:41:56.502 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:41:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T07:41:56.504 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T07:41:56.505 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T07:41:56.506 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T07:41:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T07:41:56.508 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T07:41:56.509 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T07:41:56.510 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T07:41:56.511 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:41:56.512 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:41:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:41:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T07:41:56.515 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:41:56.516 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:41:56.517 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:41:56.518 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:41:56.519 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T07:41:56.520 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:41:56.521 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T07:41:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T07:41:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T07:41:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T07:41:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:41:56.526 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:41:56.527 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T07:41:56.528 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:41:56.529 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:41:56.530 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T07:41:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:41:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:41:56.533 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T07:41:56.534 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T07:41:56.535 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:41:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T07:41:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T07:41:56.538 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T07:41:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:41:56.540 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:41:56.541 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:41:56.542 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:41:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:41:56.544 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:41:56.545 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T07:41:56.546 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T07:41:56.547 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T07:41:56.548 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:41:56.549 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T07:41:56.550 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T07:41:56.551 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T07:41:56.552 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T07:41:56.553 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:41:56.554 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T07:41:56.555 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:41:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:41:56.557 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:41:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:41:56.559 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:41:56.560 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:41:56.561 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:41:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:41:56.563 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:41:56.564 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:41:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:41:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:41:56.567 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:41:56.568 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:41:56.569 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:41:56.570 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:41:56.571 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T07:41:56.572 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:41:56.573 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:41:56.574 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:41:56.575 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:41:56.576 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:41:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:41:56.578 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:41:56.579 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:41:56.580 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:41:56.581 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:41:56.582 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:41:56.583 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:41:56.584 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:41:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:41:56.586 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:41:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T07:41:56.588 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:41:56.589 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T07:41:56.590 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:41:56.591 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:41:56.592 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:41:56.593 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:41:56.594 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T07:41:56.595 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:41:56.596 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:41:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:41:56.598 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T07:41:56.599 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T07:41:56.600 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T07:41:56.600 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:41:56.600 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T07:41:56.601 DEBUG:teuthology.orchestra.run.smithi102:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T07:41:56.608 INFO:teuthology.orchestra.run.smithi102.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:41:56.609 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:41:56.609 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:41:56.609 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T07:41:56.609 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T07:41:56.609 DEBUG:teuthology.orchestra.run.smithi102:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T07:41:56.652 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi102.front.sepia.ceph.com to complete... 2023-11-24T07:41:57.063 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:41:57.064 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:41:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-11-24T07:41:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:41:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:41:57.546 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:41:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:41:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:41:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:41:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:41:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:41:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:41:57.748 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-11-24T07:42:03.877 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:42:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:42:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-11-24T07:42:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:42:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:42:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:42:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:42:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:42:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:42:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:42:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:42:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:42:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-11-24T07:42:04.927 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T07:42:04.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T07:42:04.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T07:42:04.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:42:04.949 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:42:04.949 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:42:04.974 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T07:42:04.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:42:04.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:42:04.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:42:04.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T07:42:04.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T07:42:04.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T07:42:04.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:42:04.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:42:04.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:42:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T07:42:04.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:42:04.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:42:04.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:42:04.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T07:42:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:42:05.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:42:05.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:42:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:42:05.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T07:42:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:42:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T07:42:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:42:05.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:42:05.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:42:05.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:42:05.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:42:05.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:42:05.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T07:42:05.064 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T07:42:05.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T07:42:05.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T07:42:05.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T07:42:05.065 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T07:42:05.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T07:42:05.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T07:42:05.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T07:42:05.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T07:42:05.066 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T07:42:05.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:42:05.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:42:05.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T07:42:05.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T07:42:05.068 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:42:05.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T07:42:05.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T07:42:05.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T07:42:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T07:42:05.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T07:42:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:42:05.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:42:05.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T07:42:05.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:42:05.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:42:05.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:42:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:42:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:42:05.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:42:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:42:05.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:42:05.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:42:05.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:42:05.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:42:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:42:05.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:42:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T07:42:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:42:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:42:05.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:42:05.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:42:05.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:42:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:42:05.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T07:42:05.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T07:42:05.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:42:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:42:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:42:05.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T07:42:05.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:42:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T07:42:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T07:42:05.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T07:42:05.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:42:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T07:42:05.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T07:42:05.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T07:42:05.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:42:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:42:05.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T07:42:05.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:42:05.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T07:42:05.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:42:05.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T07:42:05.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:42:05.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T07:42:05.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T07:42:05.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T07:42:05.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:42:05.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:42:05.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T07:42:05.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T07:42:05.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T07:42:05.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T07:42:05.194 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T07:42:05.195 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:42:05.196 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:42:05.197 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:42:05.198 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:42:05.199 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:42:05.200 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T07:42:05.201 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T07:42:05.202 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T07:42:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:42:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T07:42:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:42:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T07:42:05.207 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:42:05.208 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T07:42:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:42:05.210 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:42:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:42:05.212 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:42:05.213 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:42:05.214 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T07:42:05.215 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:42:05.216 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T07:42:05.217 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T07:42:05.218 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:42:05.219 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:42:05.220 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T07:42:05.221 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T07:42:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T07:42:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:42:05.224 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T07:42:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:42:05.226 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T07:42:05.227 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:42:05.228 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T07:42:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:42:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:42:05.231 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:42:05.232 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:42:05.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:42:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T07:42:05.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:42:05.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T07:42:05.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T07:42:05.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:42:05.239 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T07:42:05.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:42:05.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T07:42:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T07:42:05.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T07:42:05.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:42:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:42:05.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T07:42:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T07:42:05.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T07:42:05.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T07:42:05.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T07:42:05.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T07:42:05.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T07:42:05.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T07:42:05.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T07:42:05.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T07:42:05.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:42:05.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:42:05.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T07:42:05.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:42:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:42:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:42:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T07:42:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:42:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:42:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:42:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T07:42:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:42:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:42:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:42:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:42:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T07:42:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T07:42:05.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T07:42:05.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:42:05.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T07:42:05.267 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T07:42:05.267 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T07:42:05.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:42:05.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:42:05.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T07:42:05.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:42:05.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:42:05.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:42:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T07:42:05.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:42:05.274 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T07:42:05.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T07:42:05.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T07:42:05.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T07:42:05.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T07:42:05.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T07:42:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T07:42:05.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:42:05.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:42:05.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:42:05.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:42:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T07:42:05.330 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:42:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T07:42:05.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:42:05.333 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T07:42:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:42:05.335 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:42:05.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T07:42:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:42:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:42:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T07:42:05.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:42:05.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:42:05.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:42:05.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T07:42:05.344 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:42:05.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:42:05.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:42:05.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:42:05.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:42:05.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:42:05.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:42:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:42:05.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:42:05.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:42:05.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:42:05.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:42:05.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:42:05.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:42:05.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:42:05.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:42:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:42:05.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:42:05.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:42:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:42:05.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:42:05.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:42:05.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:42:05.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:42:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:42:05.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:42:05.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T07:42:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:42:05.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:42:05.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:42:05.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:42:05.375 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T07:42:05.376 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T07:42:05.377 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:42:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T07:42:05.379 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T07:42:05.380 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T07:42:05.380 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T07:42:05.380 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:42:05.381 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T07:42:05.381 DEBUG:teuthology.orchestra.run.smithi005:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T07:42:05.388 INFO:teuthology.orchestra.run.smithi005.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:42:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:42:05.389 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:42:05.390 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T07:42:05.391 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T07:42:05.391 DEBUG:teuthology.orchestra.run.smithi005:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T07:42:05.431 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi005.front.sepia.ceph.com to complete... 2023-11-24T07:42:05.852 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:42:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:42:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-11-24T07:42:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:42:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:42:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:42:06.291 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:42:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:42:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:42:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:42:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:42:06.459 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:42:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-11-24T07:42:28.898 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-24T07:42:28.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:42:28.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:42:37.610 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-24T07:42:37.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:42:37.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:42:56.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-24T07:43:05.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:43:05.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:43:28.922 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T07:43:37.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:43:37.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:43:38.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-11-24T07:43:50.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:43:50.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:43:51.202 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-11-24T07:43:51.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:43:51.854 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:43:51.854 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-11-24T07:43:51.904 INFO:teuthology.orchestra.run.smithi102.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:43:51.905 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:43:51.905 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:43:51.905 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T07:43:52.906 DEBUG:teuthology.parallel:result is None 2023-11-24T07:44:05.115 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T07:44:17.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:44:17.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:44:17.341 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-11-24T07:44:18.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:44:18.197 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:44:18.198 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-11-24T07:44:18.252 INFO:teuthology.orchestra.run.smithi005.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:44:18.252 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:44:18.252 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:44:18.252 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T07:44:19.253 DEBUG:teuthology.parallel:result is None 2023-11-24T07:44:19.254 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T07:44:19.261 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T07:44:19.261 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:44:19.265 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:44:19.275 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T07:44:19.298 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T07:44:19.351 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T07:44:19.352 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:44:19.356 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:44:19.386 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T07:44:19.397 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T07:44:19.398 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:44:19.414 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:44:19.492 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:44:19.515 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:44:19.519 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:44:19.538 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:44:19.540 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T07:44:19.546 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T07:44:19.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:44:19.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:44:19.571 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T07:44:19.592 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T07:44:19.592 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:44:19.614 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:44:19.623 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:44:19.676 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:44:19.732 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:44:19.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:44:19.807 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:44:19.817 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:44:19.873 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:44:19.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:44:19.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-11-24T07:44:19.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2023-11-24T07:44:20.068 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T07:44:20.077 INFO:teuthology.task.internal:Starting timer... 2023-11-24T07:44:20.077 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T07:44:20.118 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T07:44:20.183 DEBUG:teuthology.task.selinux:Excluding smithi005: OS 'ubuntu' does not support SELinux 2023-11-24T07:44:20.183 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2023-11-24T07:44:20.183 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T07:44:20.183 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-24T07:44:20.183 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T07:44:20.183 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T07:44:20.237 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-24T07:44:20.237 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T07:44:20.254 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T07:44:20.256 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T07:53:02.291 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2023-11-24T07:53:02.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:53:02.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:53:02.373 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-11-24T07:53:02.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-24T07:53:02.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:53:02.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:53:02.578 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-11-24T07:53:02.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-24T07:53:02.722 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T07:53:02.735 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T07:53:02.736 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:53:02.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:53:02.740 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:53:02.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:53:02.778 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Command line: ntpd -gq 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: ---------------------------------------------------- 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: corporation. Support and training for ntp-4 are 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: available at https://www.nwtime.org/support 2023-11-24T07:53:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: ---------------------------------------------------- 2023-11-24T07:53:02.780 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: proto: precision = 0.044 usec (-24) 2023-11-24T07:53:02.780 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: basedate set to 2022-02-04 2023-11-24T07:53:02.780 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: gps base set to 2022-02-06 (week 2196) 2023-11-24T07:53:02.780 INFO:teuthology.orchestra.run.smithi005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:53:02.781 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:53:02.781 INFO:teuthology.orchestra.run.smithi005.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen normally on 3 ens1f0 172.21.15.5:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen normally on 4 lo [::1]:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1442%4]:123 2023-11-24T07:53:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:02 ntpd[27878]: Listening on routing socket on fd #22 for interface updates 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Command line: ntpd -gq 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: ---------------------------------------------------- 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: corporation. Support and training for ntp-4 are 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: available at https://www.nwtime.org/support 2023-11-24T07:53:02.806 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: ---------------------------------------------------- 2023-11-24T07:53:02.807 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: proto: precision = 0.042 usec (-24) 2023-11-24T07:53:02.807 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: basedate set to 2022-02-04 2023-11-24T07:53:02.807 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: gps base set to 2022-02-06 (week 2196) 2023-11-24T07:53:02.807 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:53:02.808 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:53:02.808 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen normally on 4 lo [::1]:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2023-11-24T07:53:02.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:02 ntpd[27972]: Listening on routing socket on fd #22 for interface updates 2023-11-24T07:53:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:03.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:03 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:03.806 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:03 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:03.806 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:03 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:04.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:04 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:04.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:04 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:05 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:05.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:05 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:07 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:07.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:07.811 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:07.811 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:07.811 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:07 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.780 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.781 INFO:teuthology.orchestra.run.smithi005.stdout:24 Nov 07:53:09 ntpd[27878]: ntpd: time slew +0.000603 s 2023-11-24T07:53:09.781 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew +0.000603s 2023-11-24T07:53:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T07:53:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:24 Nov 07:53:09 ntpd[27878]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T07:53:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:09 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:09.868 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T07:53:09.868 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2023-11-24T07:53:09.868 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:09.868 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:09.868 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:09.869 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:53:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:53:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:53:11.809 INFO:teuthology.orchestra.run.smithi102.stdout:24 Nov 07:53:11 ntpd[27972]: ntpd: time slew -0.003715 s 2023-11-24T07:53:11.809 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.003715s 2023-11-24T07:53:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T07:53:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:24 Nov 07:53:11 ntpd[27972]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:11.909 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:53:11.910 INFO:teuthology.run_tasks:Running task install... 2023-11-24T07:53:11.919 DEBUG:teuthology.task.install:project ceph 2023-11-24T07:53:11.919 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T07:53:11.919 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T07:53:11.920 INFO:teuthology.task.install:Using flavor: default 2023-11-24T07:53:11.926 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T07:53:11.926 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T07:53:11.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-key list | grep Ceph 2023-11-24T07:53:11.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2023-11-24T07:53:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T07:53:12.057 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T07:53:12.095 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T07:53:12.095 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T07:53:12.096 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T07:53:12.096 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T07:53:12.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:53:12.109 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T07:53:12.109 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T07:53:12.110 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T07:53:12.110 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T07:53:12.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:53:12.250 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T07:53:12.251 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:53:12.320 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T07:53:12.320 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:53:12.419 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:53:12.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T07:53:12.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2023-11-24T07:53:12.489 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:53:12.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T07:53:12.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2023-11-24T07:53:12.630 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T07:53:12.634 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T07:53:12.651 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T07:53:12.668 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T07:53:12.674 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T07:53:12.695 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T07:53:12.717 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T07:53:12.739 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T07:53:12.771 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T07:53:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T07:53:12.835 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T07:53:12.836 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T07:53:12.852 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T07:53:12.889 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T07:53:12.905 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T07:53:12.925 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T07:53:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T07:53:12.987 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T07:53:13.238 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 28.5 kB in 1s (49.3 kB/s) 2023-11-24T07:53:13.464 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 28.5 kB in 1s (39.6 kB/s) 2023-11-24T07:53:14.157 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-24T07:53:14.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:53:14.246 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-24T07:53:14.411 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2023-11-24T07:53:14.411 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2023-11-24T07:53:14.422 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-11-24T07:53:14.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:53:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-11-24T07:53:14.563 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T07:53:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T07:53:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T07:53:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T07:53:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T07:53:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T07:53:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: socat xmlstarlet 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T07:53:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: python3-watchdog 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2023-11-24T07:53:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2023-11-24T07:53:14.684 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2023-11-24T07:53:14.685 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2023-11-24T07:53:14.709 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T07:53:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T07:53:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T07:53:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T07:53:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T07:53:14.844 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T07:53:14.844 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T07:53:14.845 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T07:53:14.845 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T07:53:14.845 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T07:53:14.845 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T07:53:14.845 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T07:53:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T07:53:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: socat xmlstarlet 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T07:53:14.850 INFO:teuthology.orchestra.run.smithi005.stdout: python3-watchdog 2023-11-24T07:53:14.851 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2023-11-24T07:53:14.851 INFO:teuthology.orchestra.run.smithi005.stdout: btrfs-tools 2023-11-24T07:53:14.907 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T07:53:14.907 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 186 MB of archives. 2023-11-24T07:53:14.907 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T07:53:14.907 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T07:53:14.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T07:53:14.989 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T07:53:15.001 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2023-11-24T07:53:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T07:53:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T07:53:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T07:53:15.001 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T07:53:15.002 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T07:53:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T07:53:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T07:53:15.003 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T07:53:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T07:53:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T07:53:15.004 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T07:53:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T07:53:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T07:53:15.005 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T07:53:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T07:53:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T07:53:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T07:53:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T07:53:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T07:53:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T07:53:15.035 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T07:53:15.078 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T07:53:15.079 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 186 MB of archives. 2023-11-24T07:53:15.079 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T07:53:15.079 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T07:53:15.236 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T07:53:15.316 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T07:53:15.330 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T07:53:15.335 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T07:53:15.337 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T07:53:15.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T07:53:15.347 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T07:53:15.394 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T07:53:15.397 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T07:53:15.421 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T07:53:15.424 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T07:53:15.438 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T07:53:15.482 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T07:53:15.485 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T07:53:15.492 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T07:53:15.495 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T07:53:15.496 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T07:53:15.502 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T07:53:15.503 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T07:53:15.503 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T07:53:15.504 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T07:53:15.505 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T07:53:15.516 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T07:53:15.524 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T07:53:15.524 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T07:53:15.525 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T07:53:15.525 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T07:53:15.526 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T07:53:15.543 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T07:53:15.544 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T07:53:15.544 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T07:53:15.545 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T07:53:15.546 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T07:53:15.559 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T07:53:15.563 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T07:53:15.563 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T07:53:15.565 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T07:53:15.566 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T07:53:15.566 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T07:53:15.567 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T07:53:15.577 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T07:53:15.582 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T07:53:15.583 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T07:53:15.583 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T07:53:15.584 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T07:53:15.585 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T07:53:15.586 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T07:53:15.587 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T07:53:15.600 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T07:53:15.603 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T07:53:15.603 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T07:53:15.604 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T07:53:15.604 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T07:53:15.605 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T07:53:15.605 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T07:53:15.607 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T07:53:15.612 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T07:53:15.614 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T07:53:15.615 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T07:53:15.622 INFO:teuthology.orchestra.run.smithi005.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T07:53:15.624 INFO:teuthology.orchestra.run.smithi005.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T07:53:15.673 INFO:teuthology.orchestra.run.smithi005.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T07:53:15.674 INFO:teuthology.orchestra.run.smithi005.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T07:53:15.675 INFO:teuthology.orchestra.run.smithi005.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T07:53:15.676 INFO:teuthology.orchestra.run.smithi005.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T07:53:15.676 INFO:teuthology.orchestra.run.smithi005.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T07:53:15.678 INFO:teuthology.orchestra.run.smithi005.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T07:53:15.697 INFO:teuthology.orchestra.run.smithi005.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T07:53:15.700 INFO:teuthology.orchestra.run.smithi005.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T07:53:15.700 INFO:teuthology.orchestra.run.smithi005.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T07:53:15.718 INFO:teuthology.orchestra.run.smithi005.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T07:53:15.718 INFO:teuthology.orchestra.run.smithi005.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T07:53:15.719 INFO:teuthology.orchestra.run.smithi005.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T07:53:15.719 INFO:teuthology.orchestra.run.smithi005.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T07:53:15.720 INFO:teuthology.orchestra.run.smithi005.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T07:53:15.721 INFO:teuthology.orchestra.run.smithi005.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T07:53:15.735 INFO:teuthology.orchestra.run.smithi005.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T07:53:15.736 INFO:teuthology.orchestra.run.smithi005.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T07:53:15.740 INFO:teuthology.orchestra.run.smithi005.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T07:53:15.755 INFO:teuthology.orchestra.run.smithi005.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T07:53:15.757 INFO:teuthology.orchestra.run.smithi005.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T07:53:15.758 INFO:teuthology.orchestra.run.smithi005.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T07:53:15.761 INFO:teuthology.orchestra.run.smithi005.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T07:53:15.764 INFO:teuthology.orchestra.run.smithi005.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T07:53:15.764 INFO:teuthology.orchestra.run.smithi005.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T07:53:15.769 INFO:teuthology.orchestra.run.smithi005.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T07:53:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T07:53:15.775 INFO:teuthology.orchestra.run.smithi005.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T07:53:15.776 INFO:teuthology.orchestra.run.smithi005.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T07:53:15.776 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T07:53:15.795 INFO:teuthology.orchestra.run.smithi005.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T07:53:15.796 INFO:teuthology.orchestra.run.smithi005.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T07:53:15.797 INFO:teuthology.orchestra.run.smithi005.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T07:53:15.797 INFO:teuthology.orchestra.run.smithi005.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T07:53:15.805 INFO:teuthology.orchestra.run.smithi005.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T07:53:15.805 INFO:teuthology.orchestra.run.smithi005.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T07:53:15.806 INFO:teuthology.orchestra.run.smithi005.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T07:53:15.808 INFO:teuthology.orchestra.run.smithi005.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T07:53:15.814 INFO:teuthology.orchestra.run.smithi005.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T07:53:19.653 INFO:teuthology.orchestra.run.smithi005.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T07:53:19.654 INFO:teuthology.orchestra.run.smithi005.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T07:53:19.654 INFO:teuthology.orchestra.run.smithi005.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T07:53:19.654 INFO:teuthology.orchestra.run.smithi005.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T07:53:19.654 INFO:teuthology.orchestra.run.smithi005.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T07:53:19.655 INFO:teuthology.orchestra.run.smithi005.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T07:53:19.656 INFO:teuthology.orchestra.run.smithi005.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T07:53:19.656 INFO:teuthology.orchestra.run.smithi005.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T07:53:19.656 INFO:teuthology.orchestra.run.smithi005.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T07:53:19.656 INFO:teuthology.orchestra.run.smithi005.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T07:53:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T07:53:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T07:53:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T07:53:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T07:53:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T07:53:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T07:53:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T07:53:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T07:53:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T07:53:19.715 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T07:53:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T07:53:19.831 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T07:53:19.864 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T07:53:20.025 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T07:53:20.061 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T07:53:20.083 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T07:53:20.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T07:53:20.131 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T07:53:20.318 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T07:53:20.509 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T07:53:20.891 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T07:53:20.952 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T07:53:20.952 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T07:53:20.960 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T07:53:20.963 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T07:53:20.975 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T07:53:20.975 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T07:53:20.981 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T07:53:20.989 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T07:53:21.024 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T07:53:21.051 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T07:53:21.052 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T07:53:21.057 INFO:teuthology.orchestra.run.smithi005.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T07:53:21.057 INFO:teuthology.orchestra.run.smithi005.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T07:53:21.098 INFO:teuthology.orchestra.run.smithi005.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T07:53:21.170 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T07:53:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T07:53:21.225 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T07:53:21.236 INFO:teuthology.orchestra.run.smithi005.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T07:53:21.236 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T07:53:21.285 INFO:teuthology.orchestra.run.smithi005.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T07:53:21.292 INFO:teuthology.orchestra.run.smithi005.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T07:53:21.365 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T07:53:21.413 INFO:teuthology.orchestra.run.smithi005.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T07:53:21.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T07:53:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T07:53:21.956 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T07:53:21.956 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T07:53:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T07:53:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T07:53:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T07:53:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T07:53:25.078 INFO:teuthology.orchestra.run.smithi005.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T07:53:25.081 INFO:teuthology.orchestra.run.smithi005.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T07:53:25.082 INFO:teuthology.orchestra.run.smithi005.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T07:53:25.084 INFO:teuthology.orchestra.run.smithi005.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T07:53:25.259 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T07:53:25.260 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T07:53:25.267 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T07:53:25.270 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T07:53:25.271 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T07:53:25.271 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T07:53:25.876 INFO:teuthology.orchestra.run.smithi005.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T07:53:25.997 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T07:53:26.478 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 186 MB in 11s (17.1 MB/s) 2023-11-24T07:53:26.560 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 186 MB in 11s (16.5 MB/s) 2023-11-24T07:53:26.628 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T07:53:26.689 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T07:53:26.700 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T07:53:26.703 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T07:53:26.743 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T07:53:26.759 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T07:53:26.762 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T07:53:26.805 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T07:53:27.038 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T07:53:27.052 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T07:53:27.096 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T07:53:27.107 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T07:53:27.121 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T07:53:27.157 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T07:53:27.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T07:53:27.441 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T07:53:27.449 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T07:53:27.456 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T07:53:27.486 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T07:53:27.499 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T07:53:27.813 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T07:53:27.827 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T07:53:27.844 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T07:53:27.859 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T07:53:27.914 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T07:53:27.944 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T07:53:28.250 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T07:53:28.257 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T07:53:28.264 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T07:53:28.273 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T07:53:28.308 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T07:53:28.308 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T07:53:28.627 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T07:53:28.637 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T07:53:28.643 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T07:53:28.650 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T07:53:28.685 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T07:53:28.695 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T07:53:29.115 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T07:53:29.128 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:29.130 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T07:53:29.146 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:29.181 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:29.197 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:29.534 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T07:53:29.549 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:29.583 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:29.727 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T07:53:29.805 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:29.805 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:29.911 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T07:53:29.927 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:29.969 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:30.155 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T07:53:30.169 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T07:53:30.230 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:53:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T07:53:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T07:53:30.381 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T07:53:30.558 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T07:53:30.572 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T07:53:30.608 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T07:53:30.817 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librados2. 2023-11-24T07:53:30.892 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2023-11-24T07:53:30.892 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:30.892 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:30.892 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:30.936 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:31.262 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librbd1. 2023-11-24T07:53:31.277 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:31.320 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:31.355 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2023-11-24T07:53:31.369 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:31.414 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:31.722 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T07:53:31.738 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:31.781 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:31.833 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T07:53:31.846 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:31.891 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.075 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rados. 2023-11-24T07:53:32.091 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:32.125 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.152 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2023-11-24T07:53:32.166 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.428 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T07:53:32.443 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:32.486 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.496 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T07:53:32.511 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:32.554 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.738 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T07:53:32.754 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:32.797 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:32.815 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T07:53:32.830 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:32.874 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:33.133 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T07:53:33.149 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:33.185 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T07:53:33.191 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:33.199 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:33.477 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T07:53:33.493 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T07:53:33.527 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T07:53:33.555 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T07:53:33.569 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T07:53:33.604 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T07:53:33.763 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T07:53:33.778 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:33.821 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:33.832 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T07:53:33.846 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:33.890 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:34.166 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T07:53:34.181 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T07:53:34.224 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T07:53:34.260 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T07:53:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T07:53:34.318 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T07:53:34.569 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librgw2. 2023-11-24T07:53:34.584 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:34.627 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:34.846 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2023-11-24T07:53:34.860 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:34.904 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:35.079 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T07:53:35.094 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:35.129 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:35.365 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T07:53:35.380 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:35.415 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:35.416 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T07:53:35.431 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T07:53:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T07:53:35.701 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T07:53:35.715 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T07:53:35.759 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T07:53:36.034 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T07:53:36.046 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T07:53:36.050 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:36.060 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:36.093 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:36.095 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2023-11-24T07:53:36.496 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:36.521 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-common. 2023-11-24T07:53:36.536 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:36.540 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:36.579 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:37.630 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2023-11-24T07:53:37.644 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:37.660 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-base. 2023-11-24T07:53:37.675 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:37.698 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:37.728 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:38.400 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T07:53:38.414 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T07:53:38.431 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T07:53:38.445 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T07:53:38.458 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T07:53:38.489 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T07:53:38.703 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T07:53:38.717 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T07:53:38.753 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T07:53:38.800 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T07:53:38.815 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T07:53:38.858 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T07:53:39.048 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T07:53:39.063 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T07:53:39.106 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T07:53:39.186 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T07:53:39.202 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T07:53:39.261 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T07:53:39.442 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T07:53:39.457 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T07:53:39.497 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T07:53:39.500 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T07:53:39.512 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T07:53:39.547 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T07:53:39.803 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T07:53:39.818 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T07:53:39.858 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T07:53:39.861 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T07:53:39.874 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T07:53:39.917 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T07:53:40.106 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T07:53:40.121 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T07:53:40.156 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T07:53:40.205 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T07:53:40.218 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T07:53:40.261 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T07:53:40.459 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2023-11-24T07:53:40.473 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T07:53:40.517 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T07:53:40.563 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-portend. 2023-11-24T07:53:40.579 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T07:53:40.613 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T07:53:40.829 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T07:53:40.843 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T07:53:40.887 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T07:53:40.900 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T07:53:40.916 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T07:53:40.958 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T07:53:41.156 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T07:53:41.171 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T07:53:41.215 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T07:53:41.261 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T07:53:41.277 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T07:53:41.319 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T07:53:41.535 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T07:53:41.549 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T07:53:41.585 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T07:53:41.671 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T07:53:41.687 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T07:53:41.731 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T07:53:41.921 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T07:53:41.936 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T07:53:41.979 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T07:53:42.051 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T07:53:42.066 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T07:53:42.109 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T07:53:42.282 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T07:53:42.297 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T07:53:42.340 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T07:53:42.395 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T07:53:42.411 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T07:53:42.453 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T07:53:42.644 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2023-11-24T07:53:42.659 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T07:53:42.702 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T07:53:42.756 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-mako. 2023-11-24T07:53:42.771 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T07:53:42.814 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T07:53:43.038 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T07:53:43.053 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T07:53:43.097 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T07:53:43.134 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T07:53:43.150 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T07:53:43.184 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T07:53:43.374 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T07:53:43.389 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T07:53:43.433 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T07:53:43.520 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T07:53:43.536 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T07:53:43.586 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T07:53:43.735 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2023-11-24T07:53:43.750 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T07:53:43.802 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T07:53:43.889 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webob. 2023-11-24T07:53:43.905 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T07:53:43.956 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T07:53:44.149 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T07:53:44.163 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T07:53:44.210 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T07:53:44.384 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T07:53:44.399 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T07:53:44.453 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T07:53:44.526 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T07:53:44.541 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T07:53:44.576 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T07:53:44.812 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T07:53:44.827 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T07:53:44.846 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2023-11-24T07:53:44.861 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T07:53:44.878 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T07:53:44.904 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T07:53:45.181 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-paste. 2023-11-24T07:53:45.182 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T07:53:45.197 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T07:53:45.197 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T07:53:45.231 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T07:53:45.232 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T07:53:45.485 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T07:53:45.500 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T07:53:45.543 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T07:53:45.584 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T07:53:45.600 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T07:53:45.642 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T07:53:45.888 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T07:53:45.903 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T07:53:45.929 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T07:53:45.944 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T07:53:45.946 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T07:53:45.978 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T07:53:46.265 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T07:53:46.266 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T07:53:46.280 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T07:53:46.281 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T07:53:46.322 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T07:53:46.324 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T07:53:46.667 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T07:53:46.683 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T07:53:46.687 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T07:53:46.702 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T07:53:46.725 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T07:53:46.745 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T07:53:47.055 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T07:53:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2023-11-24T07:53:47.071 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T07:53:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T07:53:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T07:53:47.113 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T07:53:47.393 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T07:53:47.407 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T07:53:47.433 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-idna. 2023-11-24T07:53:47.449 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T07:53:47.451 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T07:53:47.491 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T07:53:47.754 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2023-11-24T07:53:47.769 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T07:53:47.811 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T07:53:47.812 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T07:53:47.826 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T07:53:47.860 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T07:53:48.172 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests. 2023-11-24T07:53:48.187 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T07:53:48.222 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T07:53:48.500 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T07:53:48.515 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T07:53:48.558 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T07:53:48.807 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T07:53:48.822 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T07:53:48.836 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T07:53:48.851 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:48.865 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T07:53:48.886 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:49.152 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T07:53:49.166 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:49.210 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:49.290 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T07:53:49.306 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:49.349 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:49.565 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T07:53:49.579 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:49.615 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:49.660 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T07:53:49.675 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T07:53:49.718 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T07:53:49.909 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T07:53:49.924 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T07:53:49.968 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T07:53:50.004 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T07:53:50.029 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:50.062 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:50.295 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T07:53:50.309 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:50.353 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:50.465 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T07:53:50.481 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:50.523 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:50.732 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T07:53:50.746 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:50.790 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:51.336 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T07:53:51.351 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:51.394 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:51.618 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T07:53:51.633 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:51.677 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:52.564 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph. 2023-11-24T07:53:52.579 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:52.622 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:52.897 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2023-11-24T07:53:52.911 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:52.955 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:52.992 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T07:53:53.007 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:53.050 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:53.266 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T07:53:53.280 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:53.316 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:53.420 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T07:53:53.435 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:53.478 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:53.627 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T07:53:53.642 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:53.686 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:53.822 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephadm. 2023-11-24T07:53:53.837 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:53.897 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:54.072 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2023-11-24T07:53:54.086 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:53:54.130 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:54.192 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T07:53:54.208 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T07:53:54.250 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T07:53:54.442 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T07:53:54.456 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T07:53:54.500 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T07:53:54.528 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T07:53:54.544 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T07:53:54.577 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T07:53:54.811 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T07:53:54.826 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T07:53:54.869 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T07:53:55.541 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-babel. 2023-11-24T07:53:55.555 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T07:53:55.599 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T07:53:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T07:53:55.917 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T07:53:55.960 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T07:53:56.024 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2023-11-24T07:53:56.038 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T07:53:56.083 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T07:53:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T07:53:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:56.405 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:56.428 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T07:53:56.441 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T07:53:56.486 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T07:53:56.725 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T07:53:56.741 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T07:53:56.775 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T07:53:56.831 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T07:53:56.845 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:56.889 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:57.162 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T07:53:57.177 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T07:53:57.219 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T07:53:57.226 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T07:53:57.240 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T07:53:57.284 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T07:53:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-routes. 2023-11-24T07:53:57.530 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T07:53:57.587 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T07:53:57.588 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T07:53:57.602 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T07:53:57.670 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T07:53:57.915 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2023-11-24T07:53:57.929 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T07:53:57.934 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T07:53:57.950 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:57.973 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T07:53:57.992 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:58.310 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T07:53:58.324 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:53:58.368 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:53:58.379 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T07:53:58.394 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T07:53:58.437 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T07:53:58.754 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T07:53:58.769 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T07:53:58.812 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T07:53:58.966 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T07:53:58.981 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T07:53:59.023 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T07:53:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T07:53:59.305 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T07:53:59.350 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T07:53:59.361 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T07:53:59.376 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T07:53:59.410 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T07:53:59.696 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T07:53:59.712 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T07:53:59.720 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T07:53:59.733 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T07:53:59.755 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T07:53:59.778 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T07:54:00.064 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T07:54:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T07:54:00.114 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T07:54:00.421 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T07:54:00.436 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:00.471 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:00.739 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T07:54:00.753 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:00.789 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:01.458 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T07:54:01.474 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T07:54:01.525 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T07:54:01.776 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T07:54:01.791 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T07:54:01.827 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T07:54:01.834 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T07:54:01.844 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T07:54:01.885 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T07:54:02.187 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T07:54:02.203 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T07:54:02.239 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T07:54:02.245 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T07:54:02.255 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T07:54:02.297 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T07:54:02.558 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T07:54:02.573 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T07:54:02.607 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T07:54:02.617 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T07:54:02.633 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T07:54:02.675 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T07:54:02.927 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T07:54:02.942 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T07:54:02.970 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T07:54:02.985 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T07:54:02.986 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T07:54:03.028 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T07:54:03.288 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T07:54:03.303 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T07:54:03.346 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T07:54:03.425 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T07:54:03.440 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T07:54:03.483 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T07:54:03.718 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T07:54:03.733 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T07:54:03.776 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T07:54:03.819 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T07:54:03.835 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T07:54:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T07:54:04.105 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T07:54:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T07:54:04.179 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T07:54:04.197 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T07:54:04.214 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T07:54:04.256 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T07:54:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T07:54:04.523 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T07:54:04.557 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T07:54:04.980 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T07:54:04.995 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:05.029 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:05.221 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T07:54:05.235 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:05.279 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T07:54:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T07:54:05.382 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T07:54:05.615 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T07:54:05.629 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T07:54:05.674 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T07:54:05.735 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T07:54:05.750 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T07:54:05.793 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T07:54:05.985 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T07:54:05.999 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T07:54:06.043 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T07:54:06.054 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package jq. 2023-11-24T07:54:06.070 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T07:54:06.129 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T07:54:06.304 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2023-11-24T07:54:06.318 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T07:54:06.362 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T07:54:06.464 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package socat. 2023-11-24T07:54:06.482 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T07:54:06.615 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2023-11-24T07:54:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T07:54:06.657 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T07:54:06.673 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T07:54:06.952 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T07:54:06.968 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T07:54:06.985 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T07:54:07.000 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T07:54:07.009 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T07:54:07.043 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T07:54:07.380 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-test. 2023-11-24T07:54:07.395 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:07.397 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2023-11-24T07:54:07.411 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:07.439 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:07.458 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:09.260 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T07:54:09.275 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:09.318 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T07:54:09.333 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:09.339 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:09.375 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:09.655 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T07:54:09.670 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:09.705 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:09.755 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T07:54:09.770 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:09.821 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:09.983 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T07:54:09.998 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T07:54:10.041 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T07:54:10.108 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T07:54:10.124 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T07:54:10.166 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T07:54:10.277 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T07:54:10.292 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:10.336 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:10.418 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T07:54:10.435 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:10.485 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:10.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T07:54:10.632 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:10.680 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:10.738 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T07:54:10.754 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T07:54:10.796 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:10.941 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T07:54:10.956 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:11.008 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:11.057 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T07:54:11.073 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:11.115 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:11.336 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T07:54:11.351 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T07:54:11.385 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T07:54:11.452 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T07:54:11.468 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T07:54:11.510 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T07:54:11.682 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T07:54:11.696 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T07:54:11.740 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T07:54:11.831 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T07:54:11.847 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T07:54:11.889 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T07:54:12.160 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T07:54:12.174 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T07:54:12.210 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T07:54:12.376 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T07:54:12.392 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T07:54:12.426 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T07:54:12.513 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T07:54:12.527 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T07:54:12.570 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T07:54:12.720 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T07:54:12.737 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T07:54:12.778 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T07:54:12.840 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T07:54:12.855 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T07:54:12.899 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T07:54:13.082 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T07:54:13.098 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T07:54:13.140 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T07:54:13.235 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T07:54:13.250 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T07:54:13.293 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T07:54:13.459 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T07:54:13.475 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T07:54:13.517 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T07:54:13.613 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2023-11-24T07:54:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T07:54:13.671 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T07:54:13.854 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-py. 2023-11-24T07:54:13.870 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T07:54:13.912 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T07:54:13.983 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T07:54:13.998 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T07:54:14.041 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T07:54:14.232 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T07:54:14.248 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T07:54:14.290 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T07:54:14.495 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T07:54:14.510 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T07:54:14.553 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T07:54:14.760 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T07:54:14.776 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T07:54:14.810 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T07:54:14.848 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2023-11-24T07:54:14.863 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T07:54:14.906 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T07:54:15.096 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-toml. 2023-11-24T07:54:15.113 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T07:54:15.154 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T07:54:15.167 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T07:54:15.182 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T07:54:15.217 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T07:54:15.457 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T07:54:15.473 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T07:54:15.515 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T07:54:15.554 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T07:54:15.569 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T07:54:15.611 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T07:54:15.811 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T07:54:15.827 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T07:54:15.894 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T07:54:15.898 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T07:54:15.913 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T07:54:15.956 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T07:54:16.147 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T07:54:16.163 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T07:54:16.205 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T07:54:16.660 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2023-11-24T07:54:16.674 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:16.718 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:16.792 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package radosgw. 2023-11-24T07:54:16.806 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:16.849 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:17.296 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T07:54:17.310 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:17.345 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:17.444 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T07:54:17.459 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T07:54:17.503 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:17.613 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T07:54:17.788 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T07:54:17.884 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T07:54:18.010 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T07:54:18.057 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T07:54:18.158 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T07:54:18.266 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T07:54:18.462 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T07:54:18.683 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T07:54:18.893 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T07:54:19.275 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T07:54:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T07:54:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:19.518 INFO:teuthology.orchestra.run.smithi005.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T07:54:19.551 INFO:teuthology.orchestra.run.smithi005.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T07:54:19.610 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2023-11-24T07:54:20.043 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T07:54:20.248 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user cephadm....done 2023-11-24T07:54:20.319 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T07:54:20.375 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T07:54:20.579 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T07:54:20.705 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T07:54:20.964 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T07:54:21.086 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T07:54:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T07:54:21.342 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T07:54:21.353 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T07:54:21.479 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T07:54:21.652 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T07:54:21.747 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T07:54:22.005 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T07:54:22.040 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T07:54:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T07:54:22.271 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T07:54:22.460 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T07:54:22.530 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T07:54:22.815 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T07:54:22.836 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T07:54:23.077 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T07:54:23.113 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T07:54:23.344 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T07:54:23.380 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T07:54:23.637 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:23.665 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T07:54:23.905 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T07:54:23.932 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T07:54:24.014 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T07:54:24.208 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T07:54:24.265 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T07:54:24.476 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:24.508 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T07:54:24.634 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T07:54:24.794 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T07:54:24.920 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T07:54:24.994 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T07:54:25.111 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T07:54:25.188 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T07:54:25.387 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T07:54:25.464 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T07:54:25.590 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T07:54:25.663 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T07:54:25.973 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T07:54:25.990 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T07:54:26.091 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T07:54:26.368 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T07:54:26.627 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T07:54:26.800 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T07:54:26.945 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T07:54:27.051 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T07:54:27.185 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T07:54:27.336 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T07:54:27.654 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T07:54:27.663 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T07:54:27.940 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T07:54:28.055 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T07:54:28.082 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T07:54:28.208 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T07:54:28.307 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T07:54:28.526 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T07:54:28.691 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T07:54:28.935 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T07:54:28.993 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T07:54:29.212 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T07:54:29.294 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T07:54:29.646 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T07:54:29.646 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T07:54:29.913 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T07:54:29.956 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T07:54:30.031 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T07:54:30.332 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T07:54:30.626 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T07:54:30.675 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T07:54:30.877 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T07:54:30.985 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:31.295 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T07:54:31.646 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T07:54:31.906 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:32.015 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T07:54:32.274 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T07:54:32.384 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T07:54:32.527 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T07:54:32.828 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T07:54:32.985 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:33.096 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T07:54:33.119 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T07:54:33.355 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:33.396 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T07:54:33.465 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T07:54:33.521 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T07:54:33.647 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T07:54:33.758 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T07:54:33.957 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T07:54:34.009 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T07:54:34.216 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T07:54:34.268 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T07:54:34.476 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:34.536 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T07:54:34.602 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T07:54:34.796 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T07:54:34.928 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T07:54:35.071 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T07:54:35.181 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T07:54:35.204 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T07:54:35.449 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T07:54:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T07:54:35.567 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T07:54:35.757 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T07:54:35.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T07:54:36.033 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T07:54:36.169 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T07:54:36.334 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T07:54:36.451 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T07:54:36.453 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T07:54:36.727 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T07:54:36.853 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T07:54:36.894 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T07:54:37.140 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T07:54:37.240 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T07:54:37.413 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T07:54:37.634 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T07:54:37.731 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T07:54:37.893 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T07:54:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T07:54:38.145 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:38.270 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T07:54:38.398 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T07:54:38.596 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T07:54:38.651 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T07:54:38.761 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T07:54:38.906 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T07:54:39.170 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T07:54:39.173 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T07:54:39.300 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T07:54:39.446 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T07:54:39.559 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T07:54:39.714 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T07:54:39.827 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T07:54:39.840 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T07:54:40.120 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T07:54:40.175 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T07:54:40.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T07:54:40.517 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T07:54:40.793 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T07:54:40.806 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T07:54:40.919 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T07:54:41.158 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T07:54:41.195 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T07:54:41.284 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:41.427 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:41.496 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T07:54:41.553 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:41.748 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:41.773 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T07:54:41.848 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:41.966 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T07:54:42.174 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T07:54:42.251 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:42.377 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:42.483 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T07:54:42.504 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:42.715 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T07:54:42.715 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T07:54:42.845 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T07:54:42.970 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.096 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.222 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.338 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.434 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.464 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.560 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.590 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:43.669 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T07:54:43.716 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T07:54:43.971 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:44.097 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:44.223 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:44.442 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T07:54:44.443 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T07:54:44.979 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.089 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.141 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.190 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.266 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.324 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.368 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.450 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:45.468 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T07:54:45.576 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:46.130 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2023-11-24T07:54:46.439 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2023-11-24T07:54:46.668 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2023-11-24T07:54:46.688 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T07:54:46.829 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T07:54:46.840 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:46.966 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:47.092 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T07:54:47.218 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:47.327 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:47.454 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:47.878 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:48.024 INFO:teuthology.orchestra.run.smithi005.stdout:Adding group ceph....done 2023-11-24T07:54:48.088 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:54:48.088 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:54:48.382 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user ceph....done 2023-11-24T07:54:48.577 INFO:teuthology.orchestra.run.smithi005.stdout:Setting system user ceph properties....done 2023-11-24T07:54:48.598 INFO:teuthology.orchestra.run.smithi005.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T07:54:48.721 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:48.750 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T07:54:48.847 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:49.153 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T07:54:49.403 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:54:49.403 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:54:49.829 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:50.023 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:50.046 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:54:50.046 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:54:50.374 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T07:54:50.680 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:50.806 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:51.001 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:51.231 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T07:54:51.232 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T07:54:51.368 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:54:51.369 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:54:51.862 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:51.991 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:52.074 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T07:54:52.074 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T07:54:52.341 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T07:54:52.729 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:53.061 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T07:54:53.061 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T07:54:53.072 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:53.319 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T07:54:53.320 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T07:54:53.814 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:53.932 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:53.941 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:54.074 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:54.161 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T07:54:54.162 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T07:54:54.285 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T07:54:54.285 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T07:54:54.792 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:54.996 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:55.121 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T07:54:55.121 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T07:54:55.297 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:55.514 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:55.746 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:55.752 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:56.021 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:56.159 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T07:54:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T07:54:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T07:54:56.888 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:56.942 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T07:54:57.031 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:57.157 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:57.310 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T07:54:57.413 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T07:54:57.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T07:54:57.492 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-24T07:54:57.658 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2023-11-24T07:54:57.659 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2023-11-24T07:54:57.661 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T07:54:57.810 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T07:54:57.811 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T07:54:57.811 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T07:54:57.811 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T07:54:57.812 INFO:teuthology.orchestra.run.smithi102.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T07:54:57.813 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2023-11-24T07:54:57.813 INFO:teuthology.orchestra.run.smithi102.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T07:54:57.813 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T07:54:57.813 INFO:teuthology.orchestra.run.smithi102.stdout: libengine-pkcs11-openssl 2023-11-24T07:54:57.863 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2023-11-24T07:54:57.863 INFO:teuthology.orchestra.run.smithi102.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T07:54:57.863 INFO:teuthology.orchestra.run.smithi102.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T07:54:57.864 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2023-11-24T07:54:57.865 INFO:teuthology.orchestra.run.smithi102.stdout: libssl3 2023-11-24T07:54:57.922 INFO:teuthology.orchestra.run.smithi102.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T07:54:57.923 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 54.6 MB of archives. 2023-11-24T07:54:57.923 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T07:54:57.923 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T07:54:58.042 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T07:54:58.106 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T07:54:58.114 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T07:54:58.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T07:54:58.121 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T07:54:58.122 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T07:54:58.122 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T07:54:58.123 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T07:54:58.124 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T07:54:58.125 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T07:54:58.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T07:54:58.145 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T07:54:58.379 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T07:54:58.381 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T07:54:58.382 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T07:54:58.384 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T07:54:58.385 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T07:54:58.389 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T07:54:58.391 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T07:54:58.398 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T07:54:58.399 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T07:54:58.421 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T07:54:58.421 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T07:54:58.432 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T07:54:58.452 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T07:54:58.455 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T07:54:58.456 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T07:54:58.457 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T07:54:58.458 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T07:54:58.470 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T07:54:58.471 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T07:54:58.638 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T07:54:58.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T07:54:58.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T07:54:58.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T07:54:58.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T07:54:58.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T07:54:58.652 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T07:54:58.652 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T07:54:58.789 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T07:54:59.033 INFO:teuthology.orchestra.run.smithi102.stdout:Preconfiguring packages ... 2023-11-24T07:54:59.175 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 54.6 MB in 1s (70.0 MB/s) 2023-11-24T07:54:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T07:54:59.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T07:54:59.332 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package flex. 2023-11-24T07:54:59.349 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-11-24T07:54:59.406 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T07:54:59.409 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T07:54:59.448 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T07:54:59.519 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2023-11-24T07:54:59.520 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2023-11-24T07:54:59.677 INFO:teuthology.orchestra.run.smithi005.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T07:54:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T07:54:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T07:54:59.679 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T07:54:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T07:54:59.681 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2023-11-24T07:54:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T07:54:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T07:54:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: libengine-pkcs11-openssl 2023-11-24T07:54:59.731 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2023-11-24T07:54:59.732 INFO:teuthology.orchestra.run.smithi005.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T07:54:59.732 INFO:teuthology.orchestra.run.smithi005.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T07:54:59.732 INFO:teuthology.orchestra.run.smithi005.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T07:54:59.732 INFO:teuthology.orchestra.run.smithi005.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T07:54:59.732 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T07:54:59.733 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T07:54:59.733 INFO:teuthology.orchestra.run.smithi005.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T07:54:59.734 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages will be upgraded: 2023-11-24T07:54:59.734 INFO:teuthology.orchestra.run.smithi005.stdout: libssl3 2023-11-24T07:54:59.790 INFO:teuthology.orchestra.run.smithi005.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T07:54:59.790 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 54.6 MB of archives. 2023-11-24T07:54:59.790 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T07:54:59.790 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T07:54:59.892 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T07:54:59.948 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T07:54:59.955 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T07:54:59.956 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T07:54:59.958 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T07:54:59.959 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T07:54:59.959 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T07:54:59.961 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T07:54:59.962 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T07:54:59.962 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T07:54:59.967 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T07:54:59.979 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T07:54:59.992 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T07:55:00.154 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T07:55:00.221 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T07:55:00.223 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T07:55:00.224 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T07:55:00.227 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T07:55:00.227 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T07:55:00.232 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T07:55:00.233 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T07:55:00.241 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T07:55:00.241 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T07:55:00.264 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T07:55:00.265 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T07:55:00.276 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T07:55:00.300 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T07:55:00.304 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T07:55:00.304 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T07:55:00.305 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T07:55:00.306 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T07:55:00.318 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T07:55:00.320 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T07:55:00.482 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T07:55:00.482 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T07:55:00.483 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T07:55:00.483 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T07:55:00.483 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T07:55:00.483 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T07:55:00.497 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T07:55:00.497 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T07:55:00.559 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:00.891 INFO:teuthology.orchestra.run.smithi005.stdout:Preconfiguring packages ... 2023-11-24T07:55:01.038 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 54.6 MB in 1s (72.3 MB/s) 2023-11-24T07:55:01.071 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package bison. 2023-11-24T07:55:01.144 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T07:55:01.147 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T07:55:01.153 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package flex. 2023-11-24T07:55:01.190 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T07:55:01.229 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T07:55:01.232 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T07:55:01.269 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T07:55:01.591 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T07:55:01.606 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T07:55:01.642 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T07:55:01.835 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T07:55:01.970 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2023-11-24T07:55:01.984 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T07:55:02.008 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T07:55:02.028 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T07:55:02.307 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2023-11-24T07:55:02.323 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:02.424 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:02.508 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T07:55:02.762 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T07:55:02.776 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T07:55:02.819 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T07:55:02.992 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package bison. 2023-11-24T07:55:03.070 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T07:55:03.073 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T07:55:03.119 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T07:55:03.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T07:55:03.288 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T07:55:03.331 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T07:55:03.562 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T07:55:03.570 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T07:55:03.576 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T07:55:03.582 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T07:55:03.617 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T07:55:03.620 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T07:55:03.912 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T07:55:03.928 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T07:55:03.956 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package dump. 2023-11-24T07:55:03.970 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:03.972 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T07:55:04.015 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T07:55:04.222 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T07:55:04.237 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T07:55:04.276 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package indent. 2023-11-24T07:55:04.281 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:04.292 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:04.326 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T07:55:04.576 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T07:55:04.590 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T07:55:04.604 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T07:55:04.620 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T07:55:04.633 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T07:55:04.662 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T07:55:04.920 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T07:55:04.935 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T07:55:04.970 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T07:55:05.016 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T07:55:05.032 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T07:55:05.074 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T07:55:05.318 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T07:55:05.334 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T07:55:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T07:55:05.688 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T07:55:05.704 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T07:55:05.746 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:06.007 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T07:55:06.023 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T07:55:06.065 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:06.318 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T07:55:06.334 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T07:55:06.347 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T07:55:06.363 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T07:55:06.376 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T07:55:06.398 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:06.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T07:55:06.632 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T07:55:06.654 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T07:55:06.670 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T07:55:06.675 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:06.721 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T07:55:06.977 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T07:55:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T07:55:07.028 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:07.372 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T07:55:07.387 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T07:55:07.430 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T07:55:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T07:55:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T07:55:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T07:55:08.178 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T07:55:08.194 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:08.236 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:08.365 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T07:55:08.382 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T07:55:08.423 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:08.606 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T07:55:08.621 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:08.664 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:08.684 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T07:55:08.700 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T07:55:08.743 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:08.958 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T07:55:08.973 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:09.016 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:09.079 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T07:55:09.095 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T07:55:09.137 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:09.269 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T07:55:09.284 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T07:55:09.327 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:09.456 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T07:55:09.472 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T07:55:09.515 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T07:55:09.834 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T07:55:09.850 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T07:55:09.881 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T07:55:09.892 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T07:55:09.895 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T07:55:09.939 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T07:55:10.245 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T07:55:10.258 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package modemmanager. 2023-11-24T07:55:10.260 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:10.273 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T07:55:10.303 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:10.308 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:10.615 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T07:55:10.631 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:10.673 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:10.906 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager. 2023-11-24T07:55:10.921 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T07:55:10.959 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T07:55:10.973 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T07:55:10.975 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:11.017 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:11.269 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T07:55:11.285 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T07:55:11.328 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:11.597 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ppp. 2023-11-24T07:55:11.612 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T07:55:11.873 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T07:55:11.889 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T07:55:11.923 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T07:55:11.951 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T07:55:12.251 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T07:55:12.259 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package modemmanager. 2023-11-24T07:55:12.265 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T07:55:12.275 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T07:55:12.301 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T07:55:12.317 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:12.640 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T07:55:12.654 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T07:55:12.698 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T07:55:12.898 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager. 2023-11-24T07:55:12.915 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T07:55:12.965 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T07:55:13.001 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T07:55:13.015 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T07:55:13.059 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T07:55:13.355 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T07:55:13.369 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:13.413 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:13.597 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ppp. 2023-11-24T07:55:13.613 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T07:55:13.961 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T07:55:14.001 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T07:55:14.015 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T07:55:14.077 INFO:teuthology.orchestra.run.smithi102.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T07:55:14.108 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-common (238) ... 2023-11-24T07:55:14.322 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T07:55:14.338 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T07:55:14.385 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T07:55:14.534 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T07:55:14.548 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:14.586 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:14.620 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T07:55:14.635 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T07:55:14.679 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T07:55:14.957 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T07:55:14.972 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T07:55:15.006 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T07:55:15.336 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T07:55:15.352 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:15.394 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:15.695 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql. 2023-11-24T07:55:15.710 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T07:55:15.754 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql (14+238) ... 2023-11-24T07:55:15.990 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T07:55:16.006 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T07:55:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T07:55:16.020 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T07:55:16.064 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T07:55:16.068 INFO:teuthology.orchestra.run.smithi005.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T07:55:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-common (238) ... 2023-11-24T07:55:16.275 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T07:55:16.290 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T07:55:16.333 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T07:55:16.539 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T07:55:16.556 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T07:55:16.592 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:16.652 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T07:55:16.667 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T07:55:16.711 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T07:55:16.988 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl. 2023-11-24T07:55:17.003 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T07:55:17.052 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T07:55:17.366 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T07:55:17.381 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T07:55:17.416 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T07:55:17.692 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql. 2023-11-24T07:55:17.707 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T07:55:17.750 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql (14+238) ... 2023-11-24T07:55:17.880 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T07:55:17.896 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T07:55:17.938 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T07:55:18.019 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T07:55:18.034 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T07:55:18.077 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T07:55:18.317 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T07:55:18.321 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T07:55:18.332 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T07:55:18.337 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T07:55:18.380 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T07:55:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T07:55:18.624 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T07:55:18.641 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T07:55:18.666 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T07:55:18.682 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T07:55:18.906 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T07:55:18.951 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl. 2023-11-24T07:55:18.968 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T07:55:19.015 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T07:55:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T07:55:19.158 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T07:55:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T07:55:19.388 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T07:55:19.404 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T07:55:19.446 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T07:55:19.469 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:19.750 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T07:55:19.767 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T07:55:19.809 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T07:55:20.296 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T07:55:20.312 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T07:55:20.371 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T07:55:20.478 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T07:55:20.575 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T07:55:20.681 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T07:55:20.894 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T07:55:20.903 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T07:55:20.903 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T07:55:21.019 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T07:55:21.145 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:21.271 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T07:55:21.406 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T07:55:21.523 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:21.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T07:55:21.729 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:21.855 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T07:55:21.973 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T07:55:22.074 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:22.200 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T07:55:22.326 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T07:55:22.535 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T07:55:22.638 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T07:55:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T07:55:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T07:55:23.065 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T07:55:23.166 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T07:55:23.261 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T07:55:23.326 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:23.452 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T07:55:23.578 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T07:55:23.704 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T07:55:23.815 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T07:55:23.830 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T07:55:23.919 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T07:55:23.933 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T07:55:24.015 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T07:55:24.059 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T07:55:24.124 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T07:55:24.210 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T07:55:24.293 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T07:55:24.336 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:24.418 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:24.462 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T07:55:24.544 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T07:55:24.630 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T07:55:24.712 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T07:55:24.838 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T07:55:25.252 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T07:55:25.400 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:25.400 INFO:teuthology.orchestra.run.smithi102.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T07:55:25.400 INFO:teuthology.orchestra.run.smithi102.stdout:which means they are currently configured by ifupdown: 2023-11-24T07:55:25.401 INFO:teuthology.orchestra.run.smithi102.stdout:- enp3s0f1 2023-11-24T07:55:25.401 INFO:teuthology.orchestra.run.smithi102.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T07:55:25.401 INFO:teuthology.orchestra.run.smithi102.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T07:55:25.401 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:25.402 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T07:55:25.498 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T07:55:25.535 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T07:55:25.562 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:25.688 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T07:55:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T07:55:25.924 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T07:55:25.939 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T07:55:26.033 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T07:55:26.140 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T07:55:26.210 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T07:55:26.304 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T07:55:26.336 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T07:55:26.529 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T07:55:26.655 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:26.789 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T07:55:26.949 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T07:55:27.016 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:27.050 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T07:55:27.117 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:27.260 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T07:55:27.386 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-common (238) ... 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout:which means they are currently configured by ifupdown: 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout:- ens1f0 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T07:55:27.636 INFO:teuthology.orchestra.run.smithi005.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T07:55:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:27.777 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T07:55:28.207 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T07:55:28.629 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T07:55:28.660 INFO:teuthology.orchestra.run.smithi102.stdout:Adding user postgres to group ssl-cert 2023-11-24T07:55:28.920 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T07:55:29.158 INFO:teuthology.orchestra.run.smithi102.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T07:55:29.159 INFO:teuthology.orchestra.run.smithi102.stdout:Removing obsolete dictionary files: 2023-11-24T07:55:29.436 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T07:55:29.587 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T07:55:29.713 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T07:55:29.831 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-common (238) ... 2023-11-24T07:55:29.850 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T07:55:30.338 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:30.702 INFO:teuthology.orchestra.run.smithi102.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T07:55:30.719 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T07:55:30.766 INFO:teuthology.orchestra.run.smithi005.stdout:Adding user postgres to group ssl-cert 2023-11-24T07:55:30.767 INFO:teuthology.orchestra.run.smithi102.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:This user must also own the server process. 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:The default text search configuration will be set to "english". 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:Data page checksums are disabled. 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:30.768 INFO:teuthology.orchestra.run.smithi102.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T07:55:30.769 INFO:teuthology.orchestra.run.smithi102.stdout:creating subdirectories ... ok 2023-11-24T07:55:30.769 INFO:teuthology.orchestra.run.smithi102.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T07:55:30.793 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default max_connections ... 100 2023-11-24T07:55:30.829 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default shared_buffers ... 128MB 2023-11-24T07:55:30.843 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default time zone ... Etc/UTC 2023-11-24T07:55:30.844 INFO:teuthology.orchestra.run.smithi102.stdout:creating configuration files ... ok 2023-11-24T07:55:31.013 INFO:teuthology.orchestra.run.smithi102.stdout:running bootstrap script ... ok 2023-11-24T07:55:31.035 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:31.035 INFO:teuthology.orchestra.run.smithi005.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T07:55:31.307 INFO:teuthology.orchestra.run.smithi005.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T07:55:31.308 INFO:teuthology.orchestra.run.smithi005.stdout:Removing obsolete dictionary files: 2023-11-24T07:55:31.620 INFO:teuthology.orchestra.run.smithi102.stdout:performing post-bootstrap initialization ... ok 2023-11-24T07:55:32.022 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T07:55:32.169 INFO:teuthology.orchestra.run.smithi102.stdout:syncing data to disk ... ok 2023-11-24T07:55:32.474 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T07:55:32.706 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T07:55:32.832 INFO:teuthology.orchestra.run.smithi005.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T07:55:32.851 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout:This user must also own the server process. 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T07:55:32.900 INFO:teuthology.orchestra.run.smithi005.stdout:The default text search configuration will be set to "english". 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout:Data page checksums are disabled. 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout:creating subdirectories ... ok 2023-11-24T07:55:32.901 INFO:teuthology.orchestra.run.smithi005.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T07:55:32.927 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default max_connections ... 100 2023-11-24T07:55:32.964 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default shared_buffers ... 128MB 2023-11-24T07:55:32.978 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default time zone ... Etc/UTC 2023-11-24T07:55:32.978 INFO:teuthology.orchestra.run.smithi005.stdout:creating configuration files ... ok 2023-11-24T07:55:33.157 INFO:teuthology.orchestra.run.smithi005.stdout:running bootstrap script ... ok 2023-11-24T07:55:33.807 INFO:teuthology.orchestra.run.smithi005.stdout:performing post-bootstrap initialization ... ok 2023-11-24T07:55:34.345 INFO:teuthology.orchestra.run.smithi005.stdout:syncing data to disk ... ok 2023-11-24T07:55:34.843 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T07:55:36.079 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:36.205 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T07:55:36.340 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql (14+238) ... 2023-11-24T07:55:36.466 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:36.592 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:36.849 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T07:55:36.849 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T07:55:37.586 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T07:55:37.879 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T07:55:38.039 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T07:55:38.116 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:38.241 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T07:55:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql (14+238) ... 2023-11-24T07:55:38.494 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T07:55:38.636 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T07:55:38.930 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T07:55:38.930 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T07:55:39.367 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T07:55:39.484 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T07:55:39.747 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T07:55:40.049 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T07:55:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T07:55:40.147 DEBUG:teuthology.parallel:result is None 2023-11-24T07:55:40.192 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T07:55:41.653 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T07:55:41.754 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T07:55:42.452 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T07:55:42.456 DEBUG:teuthology.parallel:result is None 2023-11-24T07:55:42.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:55:42.599 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-query -W -f '${Version}' ceph 2023-11-24T07:55:42.621 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:55:42.622 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:55:42.622 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T07:55:42.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:55:42.762 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2023-11-24T07:55:42.785 INFO:teuthology.orchestra.run.smithi102.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:55:42.786 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:55:42.786 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T07:55:42.786 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T07:55:42.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:42.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T07:55:42.808 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:42.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T07:55:42.850 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T07:55:42.850 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:42.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T07:55:42.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T07:55:42.936 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:42.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T07:55:42.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T07:55:43.021 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T07:55:43.022 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:43.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T07:55:43.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T07:55:43.108 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:43.109 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T07:55:43.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T07:55:43.197 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T07:55:43.198 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:43.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T07:55:43.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T07:55:43.285 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:43.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T07:55:43.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T07:55:43.370 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T07:55:43.448 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T07:55:43.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-11-24T07:55:43.452 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2023-11-24T07:55:43.473 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T07:55:43.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T07:55:43.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T07:55:43.537 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T07:55:43.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T07:55:43.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T07:55:43.608 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T07:55:43.608 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T07:55:43.608 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T07:55:43.608 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:43.608 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T07:55:43.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T07:55:43.742 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:43.743 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T07:55:43.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T07:55:43.857 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T07:55:43.857 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T07:55:43.857 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}', 'email': None, 'first_in_suite': False, 'job_id': '7465573', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-tests', 'sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9764, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-tests', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLk25BrYH4aQahsIF9eRisRqqxeyQXg8VD0LKT7euYG+DBina54QY7n6YjIO4Eeu6Go1a6VzbLED3+HUxruhOtY=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRw3/2AEIHJrlQoY1v1avzQ5H0ybWQyPKnF8iK3xe+K/iVs+bqRajUC2gVaUzdjwhhWuLNDumtZgkxeiT7YbY8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_07:31:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T07:55:43.858 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T07:55:43.862 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T07:55:43.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T07:55:43.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T07:55:43.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:43.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T07:55:43.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T07:55:43.985 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-24 07:49:25.125259818 +0000 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-24 07:49:24.709263535 +0000 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-24 07:49:24.709263535 +0000 2023-11-24T07:55:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-24 07:49:24.709263535 +0000 2023-11-24T07:55:44.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T07:55:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-24T07:55:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-24T07:55:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000263773 s, 1.9 MB/s 2023-11-24T07:55:44.101 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T07:55:44.154 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 916 Links: 1 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-24 07:49:25.377257568 +0000 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-24 07:49:25.373257603 +0000 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-24 07:49:25.373257603 +0000 2023-11-24T07:55:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-24 07:49:25.373257603 +0000 2023-11-24T07:55:44.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T07:55:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-24T07:55:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-24T07:55:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000262539 s, 2.0 MB/s 2023-11-24T07:55:44.274 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T07:55:44.326 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-24 07:49:26.477247742 +0000 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-24 07:49:26.085251244 +0000 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-24 07:49:26.085251244 +0000 2023-11-24T07:55:44.377 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-24 07:49:26.085251244 +0000 2023-11-24T07:55:44.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T07:55:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-24T07:55:44.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-24T07:55:44.444 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000264127 s, 1.9 MB/s 2023-11-24T07:55:44.446 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T07:55:44.499 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-24 07:49:27.169241561 +0000 2023-11-24T07:55:44.549 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-24 07:49:26.745245349 +0000 2023-11-24T07:55:44.550 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-24 07:49:26.745245349 +0000 2023-11-24T07:55:44.550 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-24 07:49:26.745245349 +0000 2023-11-24T07:55:44.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T07:55:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-24T07:55:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-24T07:55:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000263154 s, 1.9 MB/s 2023-11-24T07:55:44.618 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T07:55:44.671 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:44.671 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:44.671 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T07:55:44.680 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T07:55:44.680 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2023-11-24T07:55:44.730 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T07:55:44.730 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 900 Links: 1 2023-11-24T07:55:44.730 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-24 07:49:20.745348665 +0000 2023-11-24T07:55:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-24 07:49:20.353352167 +0000 2023-11-24T07:55:44.731 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-24 07:49:20.353352167 +0000 2023-11-24T07:55:44.731 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-24 07:49:20.353352167 +0000 2023-11-24T07:55:44.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T07:55:44.796 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-24T07:55:44.797 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-24T07:55:44.797 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000381777 s, 1.3 MB/s 2023-11-24T07:55:44.798 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T07:55:44.851 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-24 07:49:21.393342877 +0000 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-24 07:49:21.013346272 +0000 2023-11-24T07:55:44.906 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-24 07:49:21.013346272 +0000 2023-11-24T07:55:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-24 07:49:21.013346272 +0000 2023-11-24T07:55:44.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T07:55:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-24T07:55:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-24T07:55:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000638461 s, 802 kB/s 2023-11-24T07:55:44.970 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T07:55:45.027 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2023-11-24T07:55:45.077 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T07:55:45.078 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:45.078 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-11-24T07:55:45.078 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:45.079 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-24 07:49:22.049337018 +0000 2023-11-24T07:55:45.079 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-24 07:49:21.653340555 +0000 2023-11-24T07:55:45.079 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-24 07:49:21.653340555 +0000 2023-11-24T07:55:45.079 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-24 07:49:21.653340555 +0000 2023-11-24T07:55:45.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T07:55:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-24T07:55:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-24T07:55:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000370127 s, 1.4 MB/s 2023-11-24T07:55:45.145 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T07:55:45.203 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2023-11-24T07:55:45.253 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T07:55:45.253 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 950 Links: 1 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-24 07:49:22.681331373 +0000 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-24 07:49:22.313334660 +0000 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-24 07:49:22.313334660 +0000 2023-11-24T07:55:45.254 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-24 07:49:22.313334660 +0000 2023-11-24T07:55:45.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T07:55:45.316 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-24T07:55:45.316 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-24T07:55:45.316 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000384004 s, 1.3 MB/s 2023-11-24T07:55:45.318 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T07:55:45.375 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:45.375 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T07:55:45.375 INFO:tasks.ceph:Generating config... 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] pid file = 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T07:55:45.377 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T07:55:45.377 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T07:55:45.377 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T07:55:45.377 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T07:55:45.377 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T07:55:45.378 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T07:55:45.379 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T07:55:45.379 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T07:55:45.379 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T07:55:45.380 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T07:55:45.380 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T07:55:45.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T07:55:45.429 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T07:55:45.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T07:55:45.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:55:45.516 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]')] 2023-11-24T07:55:45.516 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T07:55:45.517 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:45.517 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T07:55:45.568 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:45.660 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:45.660 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid c1c5da79-7f10-46d9-a2ce-04e64f4e6baf 2023-11-24T07:55:45.660 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-11-24T07:55:45.660 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:fsid c1c5da79-7f10-46d9-a2ce-04e64f4e6baf 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-11-24T07:55:45.662408+0000 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-11-24T07:55:45.662408+0000 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2023-11-24T07:55:45.661 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T07:55:45.663 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T07:55:45.671 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c1c5da79-7f10-46d9-a2ce-04e64f4e6baf... 2023-11-24T07:55:45.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T07:55:45.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T07:55:45.757 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-11-24T07:55:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-11-24T07:55:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T07:55:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-11-24T07:55:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-11-24T07:55:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-11-24T07:55:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-11-24T07:55:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-11-24T07:55:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-11-24T07:55:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2023-11-24T07:55:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2023-11-24T07:55:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = c1c5da79-7f10-46d9-a2ce-04e64f4e6baf 2023-11-24T07:55:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2023-11-24T07:55:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-24T07:55:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-11-24T07:55:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug finisher = 20 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-11-24T07:55:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2023-11-24T07:55:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-11-24T07:55:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2023-11-24T07:55:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-24T07:55:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2023-11-24T07:55:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2023-11-24T07:55:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2023-11-24T07:55:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2023-11-24T07:55:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-11-24T07:55:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-11-24T07:55:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-11-24T07:55:45.773 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2023-11-24T07:55:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2023-11-24T07:55:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2023-11-24T07:55:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2023-11-24T07:55:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2023-11-24T07:55:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.5,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = c1c5da79-7f10-46d9-a2ce-04e64f4e6baf 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2023-11-24T07:55:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2023-11-24T07:55:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2023-11-24T07:55:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2023-11-24T07:55:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-11-24T07:55:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-11-24T07:55:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:55:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:55:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2023-11-24T07:55:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: debug finisher = 20 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2023-11-24T07:55:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2023-11-24T07:55:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-11-24T07:55:45.786 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2023-11-24T07:55:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2023-11-24T07:55:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2023-11-24T07:55:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2023-11-24T07:55:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-11-24T07:55:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-11-24T07:55:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-11-24T07:55:45.789 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T07:55:45.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T07:55:45.894 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T07:55:45.894 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:45.894 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T07:55:45.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:45.903 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T07:55:45.952 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:55:45.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:45.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T07:55:45.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:55:46.029 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:55:46.029 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:46.080 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:55:46.080 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:46.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T07:55:46.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:55:46.115 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:55:46.116 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:46.165 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T07:55:46.165 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T07:55:46.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T07:55:46.223 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T07:55:46.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T07:55:46.288 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T07:55:46.313 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T07:55:46.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T07:55:46.371 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T07:55:46.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T07:55:46.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T07:55:46.497 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T07:55:46.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T07:55:46.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T07:55:46.582 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T07:55:46.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T07:55:46.607 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T07:55:46.704 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T07:55:46.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T07:55:46.728 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T07:55:46.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T07:55:46.772 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T07:55:46.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T07:55:46.881 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T07:55:46.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T07:55:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T07:55:46.956 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T07:55:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T07:55:47.055 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T07:55:47.056 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T07:55:47.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T07:55:47.077 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:47.077 INFO:tasks.ceph:role: osd.0 2023-11-24T07:55:47.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:55:47.077 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:55:47.140 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:55:47.141 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:55:47.141 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:55:47.164 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-24T07:55:47.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-24T07:55:47.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T07:55:47.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T07:55:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:55:47.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:55:47.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T07:55:47.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:47.364 INFO:tasks.ceph:role: osd.1 2023-11-24T07:55:47.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:55:47.364 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:55:47.428 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:55:47.429 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:55:47.429 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:55:47.429 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:55:47.453 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-24T07:55:47.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-24T07:55:47.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T07:55:47.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T07:55:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:55:47.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:55:47.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T07:55:47.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:47.652 INFO:tasks.ceph:role: osd.2 2023-11-24T07:55:47.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:55:47.652 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:55:47.720 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:55:47.744 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-24T07:55:47.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-24T07:55:47.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T07:55:47.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T07:55:47.876 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:55:47.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:55:47.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T07:55:47.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:55:47.940 INFO:tasks.ceph:role: osd.3 2023-11-24T07:55:47.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:55:47.940 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T07:55:48.003 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:55:48.003 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:55:48.004 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:55:48.029 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-24T07:55:48.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-24T07:55:48.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T07:55:48.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T07:55:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:55:48.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:55:48.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:48.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.297+0000 7fca85b6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T07:55:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.297+0000 7fca85b6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T07:55:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.297+0000 7fca85b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:55:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.297+0000 7fca85b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:55:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.297+0000 7fca85b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:55:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:48.301+0000 7fca85b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T07:55:51.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T07:55:51.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:51.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T07:55:51.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T07:55:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:55:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:55:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:55:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:51.437+0000 7f1519d7a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T07:55:54.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T07:55:54.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T07:55:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T07:55:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:55:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:55:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:55:54.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:54.553+0000 7f4c4b167640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T07:55:57.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T07:55:57.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:55:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.641+0000 7f3abd9e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T07:55:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.641+0000 7f3abd9e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T07:55:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.645+0000 7f3abd9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:55:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.645+0000 7f3abd9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:55:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.645+0000 7f3abd9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:55:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:55:57.645+0000 7f3abd9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T07:56:00.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T07:56:00.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T07:56:00.727 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:56:00.727 INFO:tasks.ceph:role: osd.4 2023-11-24T07:56:00.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:56:00.727 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:56:00.797 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:56:00.798 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:56:00.798 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:56:01.276 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-24T07:56:01.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-24T07:56:01.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T07:56:01.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T07:56:01.435 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:56:01.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:56:01.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T07:56:01.497 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:56:01.497 INFO:tasks.ceph:role: osd.5 2023-11-24T07:56:01.497 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:56:01.497 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:56:01.569 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:56:01.570 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:56:02.010 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-24T07:56:02.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-24T07:56:02.014 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T07:56:02.111 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T07:56:02.128 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:56:02.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:56:02.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T07:56:02.193 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:56:02.193 INFO:tasks.ceph:role: osd.6 2023-11-24T07:56:02.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:56:02.194 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:56:02.265 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:56:02.266 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:56:02.266 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:56:02.731 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-24T07:56:02.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-24T07:56:02.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T07:56:02.872 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T07:56:02.889 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:56:02.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:56:02.891 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T07:56:02.957 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:56:02.958 INFO:tasks.ceph:role: osd.7 2023-11-24T07:56:02.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:56:02.958 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T07:56:03.033 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:56:03.033 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:56:03.033 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:56:03.034 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:56:03.517 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-24T07:56:03.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-24T07:56:03.520 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T07:56:03.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T07:56:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T07:56:03.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:56:03.669 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:03.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.793+0000 7f487ae44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T07:56:03.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.797+0000 7f487ae44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T07:56:03.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.797+0000 7f487ae44640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:56:03.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.797+0000 7f487ae44640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:56:03.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.797+0000 7f487ae44640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:56:03.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:03.801+0000 7f487ae44640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T07:56:06.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T07:56:06.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.905+0000 7f39a4e2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T07:56:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.909+0000 7f39a4e2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T07:56:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.909+0000 7f39a4e2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:56:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.909+0000 7f39a4e2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:56:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.909+0000 7f39a4e2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:56:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:06.909+0000 7f39a4e2e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T07:56:09.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T07:56:09.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:10.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.013+0000 7faada36e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T07:56:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.013+0000 7faada36e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T07:56:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.013+0000 7faada36e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:56:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.013+0000 7faada36e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:56:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.013+0000 7faada36e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:56:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:10.017+0000 7faada36e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T07:56:12.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T07:56:13.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:13.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.113+0000 7f0eae62b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T07:56:13.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.113+0000 7f0eae62b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T07:56:13.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.113+0000 7f0eae62b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:56:13.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.113+0000 7f0eae62b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:56:13.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.113+0000 7f0eae62b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:56:13.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:13.117+0000 7f0eae62b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T07:56:13.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:56:13.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:56:16.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T07:56:16.144 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T07:56:16.144 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T07:56:16.169 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T07:56:16.237 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T07:56:16.301 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T07:56:16.364 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T07:56:16.429 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T07:56:16.493 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T07:56:16.557 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T07:56:16.579 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T07:56:16.640 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.640 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T07:56:16.704 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T07:56:16.769 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.769 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T07:56:16.833 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T07:56:16.896 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:16.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T07:56:16.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.960 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T07:56:16.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:16.970 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T07:56:17.024 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:17.024 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T07:56:17.033 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:17.033 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T07:56:17.084 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T07:56:17.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T07:56:17.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T07:56:17.132 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlhCluDRAAhpP/EW3SMpt0vnnNFIQhUw== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2Bl4QpJFhAAyz/qcOCL6jqeZwabZzpyUA== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2Blb/7MHRAAEF1xQBfcaM7Sxh4OsI4VDw== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAEV2BlYUbrERAAQddiI7KVqeeXw002/LtxQg== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAHV2BlJSMvGhAAhxmDmsraZdk0ubMQs8zlUQ== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAKV2BlGnIPIRAAyarO4kk2ix3oxo57wnf8Zw== 2023-11-24T07:56:17.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQANV2BlNGyCJhAAzMnKPqoIUEhDMRKIi/PlIA== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlpzMTERAACmqFWBppwQ66sKgZLBCInw== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlCtqfIhAAj+DC194fUct8AC1DOayDTQ== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlGPnhKRAAKzChmMPsAcrUp5DAzjTgtg== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQATV2BlZGCoLxAA/QJZTDoqFZec/oukWz0dHg== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAWV2BlGEJSNhAAH7W6G2w5lg26TSCbC/hcfA== 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-11-24T07:56:17.134 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAaV2BlVSkZARAAQJa9KvzDuv6DplGBfalPbw== 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAdV2BlO7P8BhAAznHNHg+UsGEcKkL58su5nQ== 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlLr0xLhAAi9XusKKnaV2O6GgqSb1tVQ== 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2Bl8kqLNBAAg2h8ba0Z3XuMm6QbmUI9iA== 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlHRPnNxAAVXN7CHPAalCgLCBd5qCi9A== 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2023-11-24T07:56:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQADV2BlJds4AhAAde7b1KkXbv8KkkDbWbwgJw== 2023-11-24T07:56:17.146 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2023-11-24T07:56:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlhCluDRAAhpP/EW3SMpt0vnnNFIQhUw== 2023-11-24T07:56:17.146 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2Bl4QpJFhAAyz/qcOCL6jqeZwabZzpyUA== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2Blb/7MHRAAEF1xQBfcaM7Sxh4OsI4VDw== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAEV2BlYUbrERAAQddiI7KVqeeXw002/LtxQg== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAHV2BlJSMvGhAAhxmDmsraZdk0ubMQs8zlUQ== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAKV2BlGnIPIRAAyarO4kk2ix3oxo57wnf8Zw== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQANV2BlNGyCJhAAzMnKPqoIUEhDMRKIi/PlIA== 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2023-11-24T07:56:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlpzMTERAACmqFWBppwQ66sKgZLBCInw== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlCtqfIhAAj+DC194fUct8AC1DOayDTQ== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlGPnhKRAAKzChmMPsAcrUp5DAzjTgtg== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQATV2BlZGCoLxAA/QJZTDoqFZec/oukWz0dHg== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAWV2BlGEJSNhAAH7W6G2w5lg26TSCbC/hcfA== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAaV2BlVSkZARAAQJa9KvzDuv6DplGBfalPbw== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAdV2BlO7P8BhAAznHNHg+UsGEcKkL58su5nQ== 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-11-24T07:56:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlLr0xLhAAi9XusKKnaV2O6GgqSb1tVQ== 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2Bl8kqLNBAAg2h8ba0Z3XuMm6QbmUI9iA== 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQACV2BlHRPnNxAAVXN7CHPAalCgLCBd5qCi9A== 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2023-11-24T07:56:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQADV2BlJds4AhAAde7b1KkXbv8KkkDbWbwgJw== 2023-11-24T07:56:17.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:56:17.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:56:17.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.377 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.434 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.493 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:56:17.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:56:17.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.668 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:56:17.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:17.963 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:56:18.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.022 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.082 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.141 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:56:18.260 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T07:56:18.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T07:56:18.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:56:18.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T07:56:18.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T07:56:18.439 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:56:18.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T07:56:18.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T07:56:18.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:56:18.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T07:56:18.764 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:18.768 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:56:18.817 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T07:56:18.817 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T07:56:18.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T07:56:18.821 INFO:tasks.ceph.mon.a:Started 2023-11-24T07:56:18.822 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T07:56:18.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T07:56:18.865 INFO:tasks.ceph.mon.b:Started 2023-11-24T07:56:18.865 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T07:56:18.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T07:56:18.869 INFO:tasks.ceph.mon.c:Started 2023-11-24T07:56:18.869 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T07:56:18.869 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T07:56:18.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T07:56:18.873 INFO:tasks.ceph.mgr.y:Started 2023-11-24T07:56:18.874 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T07:56:18.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T07:56:18.878 INFO:tasks.ceph.mgr.x:Started 2023-11-24T07:56:18.878 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T07:56:18.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T07:56:19.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.020+0000 7febbcc06640 1 Processor -- start 2023-11-24T07:56:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.020+0000 7febbcc06640 1 -- start start 2023-11-24T07:56:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febbcc06640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febbcc06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febbcc06640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb8147190 con 0x7febb80b4210 2023-11-24T07:56:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febbcc06640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80b4be0 con 0x7febb8146820 2023-11-24T07:56:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febbcc06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb8146c00 con 0x7febb815eb50 2023-11-24T07:56:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:55060/0 (socket says 172.21.15.5:55060) 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 learned_addr learned my addr 172.21.15.5:0/1700937080 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:56:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:56:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.024+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:56:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.228+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:56:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:19.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:19.632+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:56:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:20.436+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:56:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 msgr2=0x7febb80b46a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7febb815eb50 0x7febb80b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 msgr2=0x7febb8070a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.102:3300/0 conn(0x7febb8146820 0x7febb8070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 -- 172.21.15.5:0/1700937080 >> v1:172.21.15.5:6789/0 conn(0x7febb80b4210 legacy=0x7febb8161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 -- 172.21.15.5:0/1700937080 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb806d030 con 0x7feb980061a0 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7feba7fff640 1 -- 172.21.15.5:0/1700937080 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80b4be0 con 0x7feb980036f0 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.024+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:56:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.228+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.228+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.228+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:56:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.632+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.632+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:22.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:22.632+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:56:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:23.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:23.436+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:56:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:23.436+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:56:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:23.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:56:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:23.436+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:56:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.184+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142606444 0 0) 0x7febb806d030 con 0x7feb980061a0 2023-11-24T07:56:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.184+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba0003530 con 0x7feb980061a0 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346960756 0 0) 0x7feba0003530 con 0x7feb980061a0 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 msgr2=0x7feb98005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 --2- 172.21.15.5:0/1700937080 >> v2:172.21.15.5:3300/0 conn(0x7feb980036f0 0x7feb98005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9800af80 con 0x7feb980061a0 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7febac001720 con 0x7feb980061a0 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 >> v1:172.21.15.102:6789/0 conn(0x7feb980061a0 legacy=0x7feb98008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb6d9d640 1 -- 172.21.15.5:0/1700937080 reap_dead start 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 0x7feba0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00047d0 0x7feba0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7feba000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80b4be0 con 0x7feba00039d0 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba000c250 con 0x7feba0005390 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba000c410 con 0x7feba00047d0 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.188+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 0x7feba0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb5d9b640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00047d0 0x7feba0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7feba000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00047d0 msgr2=0x7feba0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00047d0 0x7feba0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 msgr2=0x7feba000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7feba000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb659c640 1 -- 172.21.15.5:0/1700937080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0003530 con 0x7feba00039d0 2023-11-24T07:56:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.192+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7feba000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:24.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febb659c640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 0x7feba0003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feba8019ac0 tx=0x7feba801de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ca913562de67f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba80a6d30 con 0x7feba00039d0 2023-11-24T07:56:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800c040 con 0x7feba00039d0 2023-11-24T07:56:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febb559a640 1 -- 172.21.15.5:0/1700937080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba80ae680 con 0x7feba00039d0 2023-11-24T07:56:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 -- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 msgr2=0x7feba0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 0x7feba0003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feba8019ac0 tx=0x7feba801de30 comp rx=0 tx=0).stop 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 -- 172.21.15.5:0/1700937080 shutdown_connections 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7feba000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00047d0 0x7feba0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 --2- 172.21.15.5:0/1700937080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00039d0 0x7feba0003dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 -- 172.21.15.5:0/1700937080 >> 172.21.15.5:0/1700937080 conn(0x7febb80b2f10 msgr2=0x7febb80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 -- 172.21.15.5:0/1700937080 shutdown_connections 2023-11-24T07:56:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.196+0000 7febbcc06640 1 -- 172.21.15.5:0/1700937080 wait complete. 2023-11-24T07:56:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 Processor -- start 2023-11-24T07:56:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 -- start start 2023-11-24T07:56:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00039d0 0x7febb806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7febb80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80d1560 con 0x7feba00047d0 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80d09e0 con 0x7feba0005390 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febbcc06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb80d0cc0 con 0x7feba00039d0 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00039d0 0x7febb806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41060/0 (socket says 172.21.15.5:41060) 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 -- 172.21.15.5:0/1216401543 learned_addr learned my addr 172.21.15.5:0/1216401543 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb6d9d640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7febb80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 -- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00039d0 msgr2=0x7febb806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00039d0 0x7febb806eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 -- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 msgr2=0x7febb80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7febb80d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.200+0000 7febb5d9b640 1 -- 172.21.15.5:0/1216401543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80d0fa0 con 0x7feba00047d0 2023-11-24T07:56:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7febb5d9b640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7febac00f820 tx=0x7febac00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00fed0 con 0x7feba00047d0 2023-11-24T07:56:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0052e0 con 0x7feba00047d0 2023-11-24T07:56:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00d950 con 0x7feba00047d0 2023-11-24T07:56:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb80d1280 con 0x7feba00047d0 2023-11-24T07:56:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb806f040 con 0x7feba00047d0 2023-11-24T07:56:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7febac003600 con 0x7feba00047d0 2023-11-24T07:56:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7febac01d460 con 0x7feba00047d0 2023-11-24T07:56:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.204+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb806f230 con 0x7feba00047d0 2023-11-24T07:56:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.228+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7febac003a90 con 0x7feba00047d0 2023-11-24T07:56:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.292+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7febb804e850 con 0x7feba00047d0 2023-11-24T07:56:24.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7feba6ffd640 1 -- 172.21.15.5:0/1216401543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7febac003c30 con 0x7feba00047d0 2023-11-24T07:56:24.297 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-11-24T07:56:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 msgr2=0x7febb80cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7febac00f820 tx=0x7febac00fce0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 shutdown_connections 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feba0005390 0x7febb80d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feba00047d0 0x7febb80cfe90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 --2- 172.21.15.5:0/1216401543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feba00039d0 0x7febb806eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 >> 172.21.15.5:0/1216401543 conn(0x7febb80b2f10 msgr2=0x7febb8070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 shutdown_connections 2023-11-24T07:56:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:24.296+0000 7febbcc06640 1 -- 172.21.15.5:0/1216401543 wait complete. 2023-11-24T07:56:24.319 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T07:56:24.319 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T07:56:24.319 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:24.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T07:56:24.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:24.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T07:56:24.392 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:24.392+0000 7f6c0de24180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T07:56:24.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:24.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T07:56:24.416 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:24.409+0000 7fbe94255180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T07:56:24.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:56:24.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T07:56:24.531 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:24.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T07:56:24.552 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:24.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T07:56:24.612 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:24.612 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T07:56:24.676 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:56:24.676 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T07:56:24.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 43bcdb14-2055-47ff-b134-3f90a5ae247c 0 2023-11-24T07:56:24.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.917+0000 7f3a8489c640 1 Processor -- start 2023-11-24T07:56:24.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.917+0000 7f3a8489c640 1 -- start start 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a8489c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a8015d8f0 0x7f3a8015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a8489c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8015ecc0 con 0x7f3a800d0510 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a8489c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a800cdfb0 con 0x7f3a800ced30 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a8489c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a800d4420 con 0x7f3a8015d8f0 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a8015d8f0 0x7f3a8015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a8015d8f0 0x7f3a8015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56844/0 (socket says 172.21.15.102:56844) 2023-11-24T07:56:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 -- 172.21.15.102:0/2450181842 learned_addr learned my addr 172.21.15.102:0/2450181842 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 -- 172.21.15.102:0/2450181842 >> v1:172.21.15.102:6789/0 conn(0x7f3a800ced30 legacy=0x7f3a800cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 -- 172.21.15.102:0/2450181842 >> v1:172.21.15.5:6789/0 conn(0x7f3a800d0510 legacy=0x7f3a800d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.921+0000 7f3a7e59c640 1 -- 172.21.15.102:0/2450181842 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800d4140 con 0x7f3a8015d8f0 2023-11-24T07:56:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a7e59c640 1 --2- 172.21.15.102:0/2450181842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a8015e780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a700098a0 tx=0x7f3a7001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f99b1e088745294 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a7d59a640 1 -- 172.21.15.102:0/2450181842 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700aa650 con 0x7f3a8015d8f0 2023-11-24T07:56:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a7d59a640 1 -- 172.21.15.102:0/2450181842 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a700aa7b0 con 0x7f3a8015d8f0 2023-11-24T07:56:24.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a7d59a640 1 -- 172.21.15.102:0/2450181842 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700aab40 con 0x7f3a8015d8f0 2023-11-24T07:56:24.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- 172.21.15.102:0/2450181842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 msgr2=0x7f3a8015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 --2- 172.21.15.102:0/2450181842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a8015e780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a700098a0 tx=0x7f3a7001c4f0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- 172.21.15.102:0/2450181842 shutdown_connections 2023-11-24T07:56:24.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 --2- 172.21.15.102:0/2450181842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a8015e780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- 172.21.15.102:0/2450181842 >> 172.21.15.102:0/2450181842 conn(0x7f3a8009c750 msgr2=0x7f3a800d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:24.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- 172.21.15.102:0/2450181842 shutdown_connections 2023-11-24T07:56:24.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- 172.21.15.102:0/2450181842 wait complete. 2023-11-24T07:56:24.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 Processor -- start 2023-11-24T07:56:24.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.925+0000 7f3a8489c640 1 -- start start 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 0x7f3a80150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800c9d90 con 0x7f3a800ced30 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801558a0 con 0x7f3a8015d8f0 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80154c90 con 0x7f3a800d0510 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46108/0 (socket says 172.21.15.102:46108) 2023-11-24T07:56:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 0x7f3a80150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7dd9b640 1 -- 172.21.15.102:0/3446231890 learned_addr learned my addr 172.21.15.102:0/3446231890 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56856/0 (socket says 172.21.15.102:56856) 2023-11-24T07:56:24.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 -- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 msgr2=0x7f3a800c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 -- 172.21.15.102:0/3446231890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 msgr2=0x7f3a80150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:24.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 0x7f3a80150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 -- 172.21.15.102:0/3446231890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700094d0 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7dd9b640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7e59c640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 0x7f3a80150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a7ed9d640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a8008c8a0 tx=0x7f3a7800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003b80 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78003ce0 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a80154f70 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78005310 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a80155530 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a7800a5b0 con 0x7f3a8015d8f0 2023-11-24T07:56:24.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3a78012960 con 0x7f3a8015d8f0 2023-11-24T07:56:24.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.929+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8004e850 con 0x7f3a8015d8f0 2023-11-24T07:56:24.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:24.949+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3a78012b20 con 0x7f3a8015d8f0 2023-11-24T07:56:24.961 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:24.957+0000 7fbe94255180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T07:56:24.990 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:24.988+0000 7f6c0de24180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T07:56:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.013+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43bcdb14-2055-47ff-b134-3f90a5ae247c", "id": 0} v 0) v1 -- 0x7f3a801559e0 con 0x7f3a8015d8f0 2023-11-24T07:56:25.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a6effd640 1 -- 172.21.15.102:0/3446231890 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43bcdb14-2055-47ff-b134-3f90a5ae247c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a78012cc0 con 0x7f3a8015d8f0 2023-11-24T07:56:25.026 INFO:teuthology.orchestra.run.smithi102.stdout:0 2023-11-24T07:56:25.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 msgr2=0x7f3a800ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a8008c8a0 tx=0x7f3a7800cb90 comp rx=0 tx=0).stop 2023-11-24T07:56:25.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 shutdown_connections 2023-11-24T07:56:25.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a8015d8f0 0x7f3a800ca5e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a800d0510 0x7f3a800c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 --2- 172.21.15.102:0/3446231890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a800ced30 0x7f3a80150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 >> 172.21.15.102:0/3446231890 conn(0x7f3a8009c750 msgr2=0x7f3a800b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 shutdown_connections 2023-11-24T07:56:25.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.021+0000 7f3a8489c640 1 -- 172.21.15.102:0/3446231890 wait complete. 2023-11-24T07:56:25.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new ddd67eff-e078-4a3d-86ac-1dd32569287e 1 2023-11-24T07:56:25.159 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:25.153+0000 7fbe94255180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T07:56:25.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 Processor -- start 2023-11-24T07:56:25.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 -- start start 2023-11-24T07:56:25.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee940ce9f0 0x7fee940d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee940cef60 con 0x7fee940d1a20 2023-11-24T07:56:25.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee940cf240 con 0x7fee9415d950 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee9a891640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee940d43b0 con 0x7fee940ce9f0 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee940ce9f0 0x7fee940d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee940ce9f0 0x7fee940d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56860/0 (socket says 172.21.15.102:56860) 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 -- 172.21.15.102:0/1270498360 learned_addr learned my addr 172.21.15.102:0/1270498360 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee93fff640 1 --1- 172.21.15.102:0/1270498360 >> v1:172.21.15.102:6789/0 conn(0x7fee9415d950 0x7fee940d3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:34524/0 (socket says 172.21.15.102:34524) 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 -- 172.21.15.102:0/1270498360 >> v1:172.21.15.102:6789/0 conn(0x7fee9415d950 legacy=0x7fee940d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 -- 172.21.15.102:0/1270498360 >> v1:172.21.15.5:6789/0 conn(0x7fee940d1a20 legacy=0x7fee9406c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.181+0000 7fee937fe640 1 -- 172.21.15.102:0/1270498360 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9406b710 con 0x7fee940ce9f0 2023-11-24T07:56:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee937fe640 1 --2- 172.21.15.102:0/1270498360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940ce9f0 0x7fee940d14e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f9df1a8f653c51f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee92ffd640 1 -- 172.21.15.102:0/1270498360 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880a7070 con 0x7fee940ce9f0 2023-11-24T07:56:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee92ffd640 1 -- 172.21.15.102:0/1270498360 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee880ab430 con 0x7fee940ce9f0 2023-11-24T07:56:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee92ffd640 1 -- 172.21.15.102:0/1270498360 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880ab7c0 con 0x7fee940ce9f0 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 -- 172.21.15.102:0/1270498360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940ce9f0 msgr2=0x7fee940d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 --2- 172.21.15.102:0/1270498360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940ce9f0 0x7fee940d14e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8801c540 comp rx=0 tx=0).stop 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 -- 172.21.15.102:0/1270498360 shutdown_connections 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 --2- 172.21.15.102:0/1270498360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940ce9f0 0x7fee940d14e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 -- 172.21.15.102:0/1270498360 >> 172.21.15.102:0/1270498360 conn(0x7fee9408afc0 msgr2=0x7fee940d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 -- 172.21.15.102:0/1270498360 shutdown_connections 2023-11-24T07:56:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.185+0000 7fee9a891640 1 -- 172.21.15.102:0/1270498360 wait complete. 2023-11-24T07:56:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 Processor -- start 2023-11-24T07:56:25.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- start start 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee940ce9f0 0x7fee940ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee940b48a0 0x7fee9414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415d0f0 con 0x7fee940ce9f0 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c8be0 con 0x7fee940d1a20 2023-11-24T07:56:25.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c7fd0 con 0x7fee940b48a0 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56864/0 (socket says 172.21.15.102:56864) 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee98e2e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee940b48a0 0x7fee9414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 -- 172.21.15.102:0/166616396 learned_addr learned my addr 172.21.15.102:0/166616396 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee93fff640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee940ce9f0 0x7fee940ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 -- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee940b48a0 msgr2=0x7fee9414b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee940b48a0 0x7fee9414b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 -- 172.21.15.102:0/166616396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee940ce9f0 msgr2=0x7fee940ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee940ce9f0 0x7fee940ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 -- 172.21.15.102:0/166616396 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880094d0 con 0x7fee940d1a20 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee937fe640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee880ad040 tx=0x7fee8801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880b4800 con 0x7fee940d1a20 2023-11-24T07:56:25.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee880b4980 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee940c82b0 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880b4d30 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee940c8870 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee880be6f0 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fee880b3600 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.189+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9404e850 con 0x7fee940d1a20 2023-11-24T07:56:25.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.193+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fee880b37c0 con 0x7fee940d1a20 2023-11-24T07:56:25.210 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:25.208+0000 7f6c0de24180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T07:56:25.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.261+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ddd67eff-e078-4a3d-86ac-1dd32569287e", "id": 1} v 0) v1 -- 0x7fee940c8d20 con 0x7fee940d1a20 2023-11-24T07:56:25.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee90ff9640 1 -- 172.21.15.102:0/166616396 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ddd67eff-e078-4a3d-86ac-1dd32569287e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee880059a0 con 0x7fee940d1a20 2023-11-24T07:56:25.270 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 msgr2=0x7fee9415a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee880ad040 tx=0x7fee8801ad80 comp rx=0 tx=0).stop 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 shutdown_connections 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee940b48a0 0x7fee9414b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee940d1a20 0x7fee9415a000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 --2- 172.21.15.102:0/166616396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee940ce9f0 0x7fee940ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 >> 172.21.15.102:0/166616396 conn(0x7fee9408afc0 msgr2=0x7fee94155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 shutdown_connections 2023-11-24T07:56:25.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.265+0000 7fee9a891640 1 -- 172.21.15.102:0/166616396 wait complete. 2023-11-24T07:56:25.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new a5091443-e10c-4bc9-b567-29409ea7608a 2 2023-11-24T07:56:25.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 Processor -- start 2023-11-24T07:56:25.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 -- start start 2023-11-24T07:56:25.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad840d0510 0x7fad840d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840cdfb0 con 0x7fad8415d8f0 2023-11-24T07:56:25.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840d4140 con 0x7fad840ced30 2023-11-24T07:56:25.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad8a1a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840d4420 con 0x7fad840d0510 2023-11-24T07:56:25.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad82ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fad840ced30 0x7fad840cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:34532/0 (socket says 172.21.15.102:34532) 2023-11-24T07:56:25.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad82ffd640 1 -- 172.21.15.102:0/167014847 learned_addr learned my addr 172.21.15.102:0/167014847 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad83fff640 1 --2- 172.21.15.102:0/167014847 >> v2:172.21.15.5:3300/0 conn(0x7fad840d0510 0x7fad840d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361026281 0 0) 0x7fad840d4140 con 0x7fad840ced30 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c003530 con 0x7fad840ced30 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486627330 0 0) 0x7fad840cdfb0 con 0x7fad8415d8f0 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad840d4140 con 0x7fad8415d8f0 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad83fff640 1 -- 172.21.15.102:0/167014847 >> v1:172.21.15.102:6789/0 conn(0x7fad840ced30 legacy=0x7fad840cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad83fff640 1 -- 172.21.15.102:0/167014847 >> v1:172.21.15.5:6789/0 conn(0x7fad8415d8f0 legacy=0x7fad8415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.421+0000 7fad83fff640 1 -- 172.21.15.102:0/167014847 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840ce250 con 0x7fad840d0510 2023-11-24T07:56:25.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad83fff640 1 --2- 172.21.15.102:0/167014847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad840d0510 0x7fad840d1000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009d90 tx=0x7fad7c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a38a0b1ceb470a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0a58f0 con 0x7fad840d0510 2023-11-24T07:56:25.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c0a5a50 con 0x7fad840d0510 2023-11-24T07:56:25.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad827fc640 1 -- 172.21.15.102:0/167014847 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0a5de0 con 0x7fad840d0510 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 -- 172.21.15.102:0/167014847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad840d0510 msgr2=0x7fad840d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/167014847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad840d0510 0x7fad840d1000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009d90 tx=0x7fad7c01c920 comp rx=0 tx=0).stop 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 -- 172.21.15.102:0/167014847 shutdown_connections 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/167014847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad840d0510 0x7fad840d1000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 -- 172.21.15.102:0/167014847 >> 172.21.15.102:0/167014847 conn(0x7fad8409c750 msgr2=0x7fad840d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 -- 172.21.15.102:0/167014847 shutdown_connections 2023-11-24T07:56:25.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.425+0000 7fad8a1a1640 1 -- 172.21.15.102:0/167014847 wait complete. 2023-11-24T07:56:25.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 Processor -- start 2023-11-24T07:56:25.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- start start 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad840ced30 0x7fad840ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 0x7fad840b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840caec0 con 0x7fad8415d8f0 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840cba40 con 0x7fad840d0510 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84154cc0 con 0x7fad840ced30 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad837fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad840ced30 0x7fad840ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56870/0 (socket says 172.21.15.102:56870) 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 -- 172.21.15.102:0/1552063658 learned_addr learned my addr 172.21.15.102:0/1552063658 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad83fff640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 0x7fad840b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 -- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad840ced30 msgr2=0x7fad840ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad840ced30 0x7fad840ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 -- 172.21.15.102:0/1552063658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 msgr2=0x7fad840b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 0x7fad840b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 -- 172.21.15.102:0/1552063658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c009a70 con 0x7fad840d0510 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad83fff640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 0x7fad840b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad82ffd640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c4d0 tx=0x7fad7800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78005cf0 con 0x7fad840d0510 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78005e50 con 0x7fad840d0510 2023-11-24T07:56:25.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840cb110 con 0x7fad840d0510 2023-11-24T07:56:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78007270 con 0x7fad840d0510 2023-11-24T07:56:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840cb6d0 con 0x7fad840d0510 2023-11-24T07:56:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad7801c440 con 0x7fad840d0510 2023-11-24T07:56:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.429+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fad7801cb10 con 0x7fad840d0510 2023-11-24T07:56:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.433+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad840cb890 con 0x7fad840d0510 2023-11-24T07:56:25.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.437+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fad78021060 con 0x7fad840d0510 2023-11-24T07:56:25.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.501+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a5091443-e10c-4bc9-b567-29409ea7608a", "id": 2} v 0) v1 -- 0x7fad8404e850 con 0x7fad840d0510 2023-11-24T07:56:25.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad6bfff640 1 -- 172.21.15.102:0/1552063658 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5091443-e10c-4bc9-b567-29409ea7608a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad78017070 con 0x7fad840d0510 2023-11-24T07:56:25.511 INFO:teuthology.orchestra.run.smithi102.stdout:2 2023-11-24T07:56:25.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 msgr2=0x7fad84154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c4d0 tx=0x7fad7800c990 comp rx=0 tx=0).stop 2023-11-24T07:56:25.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 shutdown_connections 2023-11-24T07:56:25.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8415d8f0 0x7fad840b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad840d0510 0x7fad84154780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 --2- 172.21.15.102:0/1552063658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad840ced30 0x7fad840ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 >> 172.21.15.102:0/1552063658 conn(0x7fad8409c750 msgr2=0x7fad84159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 shutdown_connections 2023-11-24T07:56:25.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.505+0000 7fad8a1a1640 1 -- 172.21.15.102:0/1552063658 wait complete. 2023-11-24T07:56:25.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 17465a15-308d-4381-937c-9fda62a88e74 3 2023-11-24T07:56:25.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 Processor -- start 2023-11-24T07:56:25.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 -- start start 2023-11-24T07:56:25.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ee00ced30 0x7f2ee00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00cdfb0 con 0x7f2ee015d8f0 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00d4140 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee7c32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00d4420 con 0x7f2ee00ced30 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee61cf640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2ee00cf1e0 0x7f2ee00d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:34536/0 (socket says 172.21.15.102:34536) 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.661+0000 7f2ee61cf640 1 -- 172.21.15.102:0/3554455804 learned_addr learned my addr 172.21.15.102:0/3554455804 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-24T07:56:25.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/3554455804 >> v2:172.21.15.5:3300/0 conn(0x7f2ee00ced30 0x7f2ee00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150627417 0 0) 0x7f2ee00d4140 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003530 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee51cd640 1 -- 172.21.15.102:0/3554455804 >> v1:172.21.15.102:6789/0 conn(0x7f2ee00cf1e0 legacy=0x7f2ee00d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee51cd640 1 -- 172.21.15.102:0/3554455804 >> v1:172.21.15.5:6789/0 conn(0x7f2ee015d8f0 legacy=0x7f2ee015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355235181 0 0) 0x7f2ee00cdfb0 con 0x7f2ee015d8f0 2023-11-24T07:56:25.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee51cd640 1 -- 172.21.15.102:0/3554455804 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00ce250 con 0x7f2ee00ced30 2023-11-24T07:56:25.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/3554455804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00ced30 0x7f2ee00cfe00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097c0 tx=0x7f2ed001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aa8d1817837777 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00ab650 con 0x7f2ee00ced30 2023-11-24T07:56:25.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed00ab7b0 con 0x7f2ee00ced30 2023-11-24T07:56:25.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.665+0000 7f2ee49cc640 1 -- 172.21.15.102:0/3554455804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00abb20 con 0x7f2ee00ced30 2023-11-24T07:56:25.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- 172.21.15.102:0/3554455804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00ced30 msgr2=0x7f2ee00cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/3554455804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00ced30 0x7f2ee00cfe00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097c0 tx=0x7f2ed001c450 comp rx=0 tx=0).stop 2023-11-24T07:56:25.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- 172.21.15.102:0/3554455804 shutdown_connections 2023-11-24T07:56:25.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/3554455804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00ced30 0x7f2ee00cfe00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- 172.21.15.102:0/3554455804 >> 172.21.15.102:0/3554455804 conn(0x7f2ee009c750 msgr2=0x7f2ee00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- 172.21.15.102:0/3554455804 shutdown_connections 2023-11-24T07:56:25.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- 172.21.15.102:0/3554455804 wait complete. 2023-11-24T07:56:25.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 Processor -- start 2023-11-24T07:56:25.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- start start 2023-11-24T07:56:25.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 0x7f2ee0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 0x7f2ee00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b8560 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b7950 con 0x7f2ee015d8f0 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee7c32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b7c30 con 0x7f2ee00ced30 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee61cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee59ce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 0x7f2ee0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee59ce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 0x7f2ee0150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46126/0 (socket says 172.21.15.102:46126) 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee61cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56884/0 (socket says 172.21.15.102:56884) 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee59ce640 1 -- 172.21.15.102:0/2071426866 learned_addr learned my addr 172.21.15.102:0/2071426866 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.669+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 0x7f2ee00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 -- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 msgr2=0x7f2ee0150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 0x7f2ee0150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 -- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 msgr2=0x7f2ee0156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 -- 172.21.15.102:0/2071426866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0009420 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee61cf640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee51cd640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 0x7f2ee00b7120 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00ac000 tx=0x7f2ed001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00bf610 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed00bf770 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee00b7f10 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00bfae0 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee00b7660 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ed00b5400 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2ed00b4820 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.673+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee00b8710 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.677+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2ee00b8710 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.741+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "17465a15-308d-4381-937c-9fda62a88e74", "id": 3} v 0) v1 -- 0x7f2ee004e850 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ed67fc640 1 -- 172.21.15.102:0/2071426866 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17465a15-308d-4381-937c-9fda62a88e74", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ed00b4390 con 0x7f2ee00cf1e0 2023-11-24T07:56:25.750 INFO:teuthology.orchestra.run.smithi102.stdout:3 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 msgr2=0x7f2ee00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 0x7f2ee00b7120 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00ac000 tx=0x7f2ed001ac90 comp rx=0 tx=0).stop 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 shutdown_connections 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee015d8f0 0x7f2ee0156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee00cf1e0 0x7f2ee00b7120 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 --2- 172.21.15.102:0/2071426866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ee00ced30 0x7f2ee0150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 >> 172.21.15.102:0/2071426866 conn(0x7f2ee009c750 msgr2=0x7f2ee0168eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 shutdown_connections 2023-11-24T07:56:25.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.745+0000 7f2ee7c32640 1 -- 172.21.15.102:0/2071426866 wait complete. 2023-11-24T07:56:25.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 496a8096-a74d-4544-8181-82af64cb4549 4 2023-11-24T07:56:25.827 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:25.821+0000 7fbe94255180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T07:56:25.882 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:25.880+0000 7f6c0de24180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T07:56:25.891 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:25.885+0000 7fbe94255180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T07:56:25.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 Processor -- start 2023-11-24T07:56:25.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 -- start start 2023-11-24T07:56:25.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4580ced30 0x7fa4580cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4580cf1b0 0x7fa4580d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4580d4420 con 0x7fa4580cf1b0 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45815ecc0 con 0x7fa4580ced30 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45d1a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4580cdfb0 con 0x7fa45815d8f0 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4580ced30 0x7fa4580cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa456d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4580ced30 0x7fa4580cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56896/0 (socket says 172.21.15.102:56896) 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa456d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46134/0 (socket says 172.21.15.102:46134) 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 -- 172.21.15.102:0/3889841752 learned_addr learned my addr 172.21.15.102:0/3889841752 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa45759e640 1 --2- 172.21.15.102:0/3889841752 >> v2:172.21.15.5:3300/0 conn(0x7fa4580cf1b0 0x7fa4580d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 -- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 msgr2=0x7fa45815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 -- 172.21.15.102:0/3889841752 >> v2:172.21.15.5:3300/0 conn(0x7fa4580cf1b0 msgr2=0x7fa4580d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 --2- 172.21.15.102:0/3889841752 >> v2:172.21.15.5:3300/0 conn(0x7fa4580cf1b0 0x7fa4580d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa44ffff640 1 -- 172.21.15.102:0/3889841752 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580d4140 con 0x7fa4580ced30 2023-11-24T07:56:25.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.901+0000 7fa456d9d640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:25.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa44ffff640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4580ced30 0x7fa4580cfe00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa45808c040 tx=0x7fa44001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21b48a9721587f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45659c640 1 -- 172.21.15.102:0/3889841752 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400aa5f0 con 0x7fa4580ced30 2023-11-24T07:56:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45659c640 1 -- 172.21.15.102:0/3889841752 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4400aa750 con 0x7fa4580ced30 2023-11-24T07:56:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45659c640 1 -- 172.21.15.102:0/3889841752 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400aaae0 con 0x7fa4580ced30 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 -- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4580ced30 msgr2=0x7fa4580cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4580ced30 0x7fa4580cfe00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa45808c040 tx=0x7fa44001c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 -- 172.21.15.102:0/3889841752 shutdown_connections 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/3889841752 >> v2:172.21.15.5:3300/0 conn(0x7fa4580cf1b0 0x7fa4580d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4580ced30 0x7fa4580cfe00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/3889841752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa45815d8f0 0x7fa45815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 -- 172.21.15.102:0/3889841752 >> 172.21.15.102:0/3889841752 conn(0x7fa45809c750 msgr2=0x7fa4580d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 -- 172.21.15.102:0/3889841752 shutdown_connections 2023-11-24T07:56:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.905+0000 7fa45d1a1640 1 -- 172.21.15.102:0/3889841752 wait complete. 2023-11-24T07:56:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 Processor -- start 2023-11-24T07:56:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- start start 2023-11-24T07:56:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 0x7fa458143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 0x7fa458154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458155c30 con 0x7fa4580ced30 2023-11-24T07:56:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458155670 con 0x7fa45815d8f0 2023-11-24T07:56:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa458155950 con 0x7fa4580cf1b0 2023-11-24T07:56:25.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 0x7fa458154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56898/0 (socket says 172.21.15.102:56898) 2023-11-24T07:56:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 -- 172.21.15.102:0/1565897886 learned_addr learned my addr 172.21.15.102:0/1565897886 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa456d9d640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 0x7fa458143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 -- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 msgr2=0x7fa458154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 0x7fa458154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 -- 172.21.15.102:0/1565897886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 msgr2=0x7fa458143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 0x7fa458143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 -- 172.21.15.102:0/1565897886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009420 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44ffff640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 0x7fa458154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa456d9d640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 0x7fa458143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45759e640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa45000eed0 tx=0x7fa45000b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450010040 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000bd20 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450014640 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4400094d0 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45815b190 con 0x7fa45815d8f0 2023-11-24T07:56:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa450014aa0 con 0x7fa45815d8f0 2023-11-24T07:56:25.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.909+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa450014d50 con 0x7fa45815d8f0 2023-11-24T07:56:25.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.913+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45815ad10 con 0x7fa45815d8f0 2023-11-24T07:56:25.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.913+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa45815ad10 con 0x7fa45815d8f0 2023-11-24T07:56:25.947 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:25.944+0000 7f6c0de24180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T07:56:25.954 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:25.949+0000 7fbe94255180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T07:56:25.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.981+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "496a8096-a74d-4544-8181-82af64cb4549", "id": 4} v 0) v1 -- 0x7fa45815b380 con 0x7fa45815d8f0 2023-11-24T07:56:25.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa44f7fe640 1 -- 172.21.15.102:0/1565897886 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "496a8096-a74d-4544-8181-82af64cb4549", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa450018020 con 0x7fa45815d8f0 2023-11-24T07:56:25.991 INFO:teuthology.orchestra.run.smithi102.stdout:4 2023-11-24T07:56:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 msgr2=0x7fa4580b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa45000eed0 tx=0x7fa45000b480 comp rx=0 tx=0).stop 2023-11-24T07:56:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 shutdown_connections 2023-11-24T07:56:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa45815d8f0 0x7fa4580b0b60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4580cf1b0 0x7fa458154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 --2- 172.21.15.102:0/1565897886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4580ced30 0x7fa458143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:25.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 >> 172.21.15.102:0/1565897886 conn(0x7fa45809c750 msgr2=0x7fa458159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:25.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 shutdown_connections 2023-11-24T07:56:25.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:25.985+0000 7fa45d1a1640 1 -- 172.21.15.102:0/1565897886 wait complete. 2023-11-24T07:56:26.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 7e8ee2db-1311-4e79-ac74-948deb99d7a5 5 2023-11-24T07:56:26.011 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.008+0000 7f6c0de24180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T07:56:26.047 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.041+0000 7fbe94255180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T07:56:26.104 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.104+0000 7f6c0de24180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T07:56:26.108 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.101+0000 7fbe94255180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T07:56:26.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 Processor -- start 2023-11-24T07:56:26.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 -- start start 2023-11-24T07:56:26.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0c440cf1b0 0x7f0c440d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c440cdfb0 con 0x7f0c4415d8f0 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440d4420 con 0x7f0c440cf1b0 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4c72a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440d4140 con 0x7f0c440ced30 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46156/0 (socket says 172.21.15.102:46156) 2023-11-24T07:56:26.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 -- 172.21.15.102:0/81879789 learned_addr learned my addr 172.21.15.102:0/81879789 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c4acc7640 1 --2- 172.21.15.102:0/81879789 >> v2:172.21.15.102:3300/0 conn(0x7f0c440cf1b0 0x7f0c440d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 -- 172.21.15.102:0/81879789 >> v2:172.21.15.102:3300/0 conn(0x7f0c440cf1b0 msgr2=0x7f0c440d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 --2- 172.21.15.102:0/81879789 >> v2:172.21.15.102:3300/0 conn(0x7f0c440cf1b0 0x7f0c440d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 -- 172.21.15.102:0/81879789 >> v1:172.21.15.102:6789/0 conn(0x7f0c4415d8f0 legacy=0x7f0c4415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.145+0000 7f0c49cc5640 1 -- 172.21.15.102:0/81879789 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440ce250 con 0x7f0c440ced30 2023-11-24T07:56:26.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c49cc5640 1 --2- 172.21.15.102:0/81879789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009870 tx=0x7f0c3401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49159e23302cf0ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c494c4640 1 -- 172.21.15.102:0/81879789 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340aa5f0 con 0x7f0c440ced30 2023-11-24T07:56:26.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c494c4640 1 -- 172.21.15.102:0/81879789 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340aa750 con 0x7f0c440ced30 2023-11-24T07:56:26.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c494c4640 1 -- 172.21.15.102:0/81879789 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340aaae0 con 0x7f0c440ced30 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 -- 172.21.15.102:0/81879789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 msgr2=0x7f0c440cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/81879789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009870 tx=0x7f0c3401c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 -- 172.21.15.102:0/81879789 shutdown_connections 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/81879789 >> v2:172.21.15.102:3300/0 conn(0x7f0c440cf1b0 0x7f0c440d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/81879789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c440cfe00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 -- 172.21.15.102:0/81879789 >> 172.21.15.102:0/81879789 conn(0x7f0c4409c750 msgr2=0x7f0c440d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 -- 172.21.15.102:0/81879789 shutdown_connections 2023-11-24T07:56:26.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.149+0000 7f0c4c72a640 1 -- 172.21.15.102:0/81879789 wait complete. 2023-11-24T07:56:26.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 Processor -- start 2023-11-24T07:56:26.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- start start 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c4415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c4415d8f0 0x7f0c440cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440caf00 con 0x7f0c4415d8f0 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4415bf10 con 0x7f0c440cf1b0 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440cb860 con 0x7f0c440ced30 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56924/0 (socket says 172.21.15.102:56924) 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4a4c6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c4415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 -- 172.21.15.102:0/3841457188 learned_addr learned my addr 172.21.15.102:0/3841457188 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:26.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4acc7640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c4415d8f0 0x7f0c440cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 -- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 msgr2=0x7f0c4415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c4415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 -- 172.21.15.102:0/3841457188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c4415d8f0 msgr2=0x7f0c440cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c4415d8f0 0x7f0c440cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 -- 172.21.15.102:0/3841457188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340094d0 con 0x7f0c440cf1b0 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4a4c6640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c4415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:26.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c49cc5640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ac040 tx=0x7f0c3401ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b3800 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340b3980 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c440ca5a0 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b3d30 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c440cab20 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c340bd6f0 con 0x7f0c440cf1b0 2023-11-24T07:56:26.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.153+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0c340a7070 con 0x7f0c440cf1b0 2023-11-24T07:56:26.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.157+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c440cb040 con 0x7f0c440cf1b0 2023-11-24T07:56:26.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.157+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0c440cb040 con 0x7f0c440cf1b0 2023-11-24T07:56:26.167 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.164+0000 7f6c0de24180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T07:56:26.203 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.197+0000 7fbe94255180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T07:56:26.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.225+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e8ee2db-1311-4e79-ac74-948deb99d7a5", "id": 5} v 0) v1 -- 0x7f0c4404e850 con 0x7f0c440cf1b0 2023-11-24T07:56:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c3affd640 1 -- 172.21.15.102:0/3841457188 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e8ee2db-1311-4e79-ac74-948deb99d7a5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c340bd9a0 con 0x7f0c440cf1b0 2023-11-24T07:56:26.235 INFO:teuthology.orchestra.run.smithi102.stdout:5 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 msgr2=0x7f0c4415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ac040 tx=0x7f0c3401ad10 comp rx=0 tx=0).stop 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 shutdown_connections 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c4415d8f0 0x7f0c440cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c440cf1b0 0x7f0c4415b9d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 --2- 172.21.15.102:0/3841457188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c440ced30 0x7f0c4415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 >> 172.21.15.102:0/3841457188 conn(0x7f0c4409c750 msgr2=0x7f0c44157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 shutdown_connections 2023-11-24T07:56:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.229+0000 7f0c4c72a640 1 -- 172.21.15.102:0/3841457188 wait complete. 2023-11-24T07:56:26.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 075db409-227d-4df1-afba-9177b0bda347 6 2023-11-24T07:56:26.260 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.260+0000 7f6c0de24180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T07:56:26.265 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.261+0000 7fbe94255180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T07:56:26.323 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.320+0000 7f6c0de24180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T07:56:26.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 Processor -- start 2023-11-24T07:56:26.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 -- start start 2023-11-24T07:56:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f464415d2a0 0x7f46440d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440b6250 con 0x7f46440d2c20 2023-11-24T07:56:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440ce8c0 con 0x7f464415d2a0 2023-11-24T07:56:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464aac8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4644161cf0 con 0x7f46440b5350 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f4649ac6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f464415d2a0 0x7f46440d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f464a2c7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f4649ac6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f464415d2a0 0x7f46440d26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56940/0 (socket says 172.21.15.102:56940) 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.397+0000 7f4649ac6640 1 -- 172.21.15.102:0/3013112559 learned_addr learned my addr 172.21.15.102:0/3013112559 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4649ac6640 1 -- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 msgr2=0x7f46440d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4649ac6640 1 --2- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4649ac6640 1 -- 172.21.15.102:0/3013112559 >> v1:172.21.15.5:6789/0 conn(0x7f46440d2c20 legacy=0x7f46440b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4649ac6640 1 -- 172.21.15.102:0/3013112559 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644161170 con 0x7f464415d2a0 2023-11-24T07:56:26.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4649ac6640 1 --2- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f464415d2a0 0x7f46440d26e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4640009870 tx=0x7f464001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd6f67a7645a6cc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4648ac4640 1 -- 172.21.15.102:0/3013112559 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400aa670 con 0x7f464415d2a0 2023-11-24T07:56:26.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4648ac4640 1 -- 172.21.15.102:0/3013112559 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400aa7d0 con 0x7f464415d2a0 2023-11-24T07:56:26.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f4648ac4640 1 -- 172.21.15.102:0/3013112559 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400aab60 con 0x7f464415d2a0 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f464aac8640 1 -- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f464415d2a0 msgr2=0x7f46440d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.401+0000 7f464aac8640 1 --2- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f464415d2a0 0x7f46440d26e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4640009870 tx=0x7f464001c510 comp rx=0 tx=0).stop 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- 172.21.15.102:0/3013112559 shutdown_connections 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 --2- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 --2- 172.21.15.102:0/3013112559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f464415d2a0 0x7f46440d26e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- 172.21.15.102:0/3013112559 >> 172.21.15.102:0/3013112559 conn(0x7f46440668a0 msgr2=0x7f46440cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- 172.21.15.102:0/3013112559 shutdown_connections 2023-11-24T07:56:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- 172.21.15.102:0/3013112559 wait complete. 2023-11-24T07:56:26.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 Processor -- start 2023-11-24T07:56:26.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- start start 2023-11-24T07:56:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 0x7f464415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f464415d2a0 0x7f46440cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464415b970 con 0x7f464415d2a0 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440cc2f0 con 0x7f46440d2c20 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464aac8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46440cc010 con 0x7f46440b5350 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f4649ac6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 0x7f464415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f4649ac6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46198/0 (socket says 172.21.15.102:46198) 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f4649ac6640 1 -- 172.21.15.102:0/3476810897 learned_addr learned my addr 172.21.15.102:0/3476810897 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f464a2c7640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f464415d2a0 0x7f46440cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 -- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 msgr2=0x7f46440c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 -- 172.21.15.102:0/3476810897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f464415d2a0 msgr2=0x7f46440cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f464415d2a0 0x7f46440cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 -- 172.21.15.102:0/3476810897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400094d0 con 0x7f46440d2c20 2023-11-24T07:56:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f4649ac6640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.405+0000 7f46492c5640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 0x7f464415bd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46440c9fc0 tx=0x7f463400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340052d0 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634005430 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464415b2b0 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634003860 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46440c8e70 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4634003cc0 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4634012420 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464415bab0 con 0x7f46440d2c20 2023-11-24T07:56:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.409+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f464415bab0 con 0x7f46440d2c20 2023-11-24T07:56:26.427 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.421+0000 7fbe94255180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T07:56:26.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.477+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "075db409-227d-4df1-afba-9177b0bda347", "id": 6} v 0) v1 -- 0x7f4644074990 con 0x7f46440d2c20 2023-11-24T07:56:26.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f463a7fc640 1 -- 172.21.15.102:0/3476810897 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "075db409-227d-4df1-afba-9177b0bda347", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4634017070 con 0x7f46440d2c20 2023-11-24T07:56:26.487 INFO:teuthology.orchestra.run.smithi102.stdout:6 2023-11-24T07:56:26.487 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.488+0000 7f6c0de24180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T07:56:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 msgr2=0x7f464415bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 0x7f464415bd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46440c9fc0 tx=0x7f463400c820 comp rx=0 tx=0).stop 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 shutdown_connections 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f464415d2a0 0x7f46440cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46440d2c20 0x7f464415bd90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 --2- 172.21.15.102:0/3476810897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46440b5350 0x7f46440c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 >> 172.21.15.102:0/3476810897 conn(0x7f46440668a0 msgr2=0x7f464415f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 shutdown_connections 2023-11-24T07:56:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.481+0000 7f464aac8640 1 -- 172.21.15.102:0/3476810897 wait complete. 2023-11-24T07:56:26.498 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:26.493+0000 7fbe94255180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T07:56:26.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new fc0e2708-a0c0-462a-b902-c294b8ec7d8f 7 2023-11-24T07:56:26.560 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:26.560+0000 7f6c0de24180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T07:56:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.637+0000 7fae1d18d640 1 Processor -- start 2023-11-24T07:56:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.637+0000 7fae1d18d640 1 -- start start 2023-11-24T07:56:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.637+0000 7fae1d18d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae1815d8f0 0x7fae1815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1d18d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1d18d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1815ecc0 con 0x7fae180cf1b0 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1d18d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180d4420 con 0x7fae1815d8f0 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1d18d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180cdfb0 con 0x7fae180ced30 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1759e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fae180cf1b0 0x7fae180d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:34548/0 (socket says 172.21.15.102:34548) 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:46202/0 (socket says 172.21.15.102:46202) 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1759e640 1 -- 172.21.15.102:0/2085064386 learned_addr learned my addr 172.21.15.102:0/2085064386 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae16d9d640 1 --2- 172.21.15.102:0/2085064386 >> v2:172.21.15.5:3300/0 conn(0x7fae1815d8f0 0x7fae1815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 -- 172.21.15.102:0/2085064386 >> v2:172.21.15.5:3300/0 conn(0x7fae1815d8f0 msgr2=0x7fae1815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 --2- 172.21.15.102:0/2085064386 >> v2:172.21.15.5:3300/0 conn(0x7fae1815d8f0 0x7fae1815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 -- 172.21.15.102:0/2085064386 >> v1:172.21.15.102:6789/0 conn(0x7fae180cf1b0 legacy=0x7fae180d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 -- 172.21.15.102:0/2085064386 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180d4140 con 0x7fae180ced30 2023-11-24T07:56:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae15d9b640 1 -- 172.21.15.102:0/2085064386 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816587383 0 0) 0x7fae1815ecc0 con 0x7fae180cf1b0 2023-11-24T07:56:26.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae1659c640 1 --2- 172.21.15.102:0/2085064386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0097c0 tx=0x7fae0c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96b7128f3f96bd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae15d9b640 1 -- 172.21.15.102:0/2085064386 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0ab650 con 0x7fae180ced30 2023-11-24T07:56:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae15d9b640 1 -- 172.21.15.102:0/2085064386 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c0ab7b0 con 0x7fae180ced30 2023-11-24T07:56:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.641+0000 7fae15d9b640 1 -- 172.21.15.102:0/2085064386 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0abb40 con 0x7fae180ced30 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- 172.21.15.102:0/2085064386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 msgr2=0x7fae180cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- 172.21.15.102:0/2085064386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0097c0 tx=0x7fae0c01c450 comp rx=0 tx=0).stop 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- 172.21.15.102:0/2085064386 shutdown_connections 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- 172.21.15.102:0/2085064386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180ced30 0x7fae180cfe00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- 172.21.15.102:0/2085064386 >> v2:172.21.15.5:3300/0 conn(0x7fae1815d8f0 0x7fae1815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- 172.21.15.102:0/2085064386 >> 172.21.15.102:0/2085064386 conn(0x7fae1809c750 msgr2=0x7fae180d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- 172.21.15.102:0/2085064386 shutdown_connections 2023-11-24T07:56:26.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- 172.21.15.102:0/2085064386 wait complete. 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 Processor -- start 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- start start 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180cf1b0 0x7fae180b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1815d8f0 0x7fae180b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b6ca0 con 0x7fae1815d8f0 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b6f80 con 0x7fae180ced30 2023-11-24T07:56:26.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1d18d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b7260 con 0x7fae180cf1b0 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae1659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180cf1b0 0x7fae180b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae16d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56946/0 (socket says 172.21.15.102:56946) 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.645+0000 7fae16d9d640 1 -- 172.21.15.102:0/3338818519 learned_addr learned my addr 172.21.15.102:0/3338818519 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae1759e640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1815d8f0 0x7fae180b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 -- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180cf1b0 msgr2=0x7fae180b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180cf1b0 0x7fae180b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 -- 172.21.15.102:0/3338818519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1815d8f0 msgr2=0x7fae180b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1815d8f0 0x7fae180b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 -- 172.21.15.102:0/3338818519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009420 con 0x7fae180ced30 2023-11-24T07:56:26.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae16d9d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae0800e930 tx=0x7fae0800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08009690 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0800ca00 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180b7540 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800cd70 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae181556f0 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae08005ca0 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fae08013470 con 0x7fae180ced30 2023-11-24T07:56:26.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.649+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1804e850 con 0x7fae180ced30 2023-11-24T07:56:26.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.653+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fae08021060 con 0x7fae180ced30 2023-11-24T07:56:26.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.717+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc0e2708-a0c0-462a-b902-c294b8ec7d8f", "id": 7} v 0) v1 -- 0x7fae180cf9d0 con 0x7fae180ced30 2023-11-24T07:56:26.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fadff7fe640 1 -- 172.21.15.102:0/3338818519 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc0e2708-a0c0-462a-b902-c294b8ec7d8f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae08029020 con 0x7fae180ced30 2023-11-24T07:56:26.727 INFO:teuthology.orchestra.run.smithi102.stdout:7 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 msgr2=0x7fae181551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae0800e930 tx=0x7fae0800edf0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 shutdown_connections 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae1815d8f0 0x7fae180b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae180cf1b0 0x7fae180b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 --2- 172.21.15.102:0/3338818519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae180ced30 0x7fae181551b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 >> 172.21.15.102:0/3338818519 conn(0x7fae1809c750 msgr2=0x7fae1815c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 shutdown_connections 2023-11-24T07:56:26.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T07:56:26.721+0000 7fae1d18d640 1 -- 172.21.15.102:0/3338818519 wait complete. 2023-11-24T07:56:26.746 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T07:56:26.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T07:56:26.749 INFO:tasks.ceph.osd.0:Started 2023-11-24T07:56:26.750 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T07:56:26.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T07:56:26.755 INFO:tasks.ceph.osd.1:Started 2023-11-24T07:56:26.755 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T07:56:26.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T07:56:26.759 INFO:tasks.ceph.osd.2:Started 2023-11-24T07:56:26.759 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T07:56:26.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T07:56:26.764 INFO:tasks.ceph.osd.3:Started 2023-11-24T07:56:26.764 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T07:56:26.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T07:56:26.768 INFO:tasks.ceph.osd.4:Started 2023-11-24T07:56:26.768 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T07:56:26.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T07:56:26.772 INFO:tasks.ceph.osd.5:Started 2023-11-24T07:56:26.772 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T07:56:26.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T07:56:26.775 INFO:tasks.ceph.osd.6:Started 2023-11-24T07:56:26.775 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T07:56:26.776 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T07:56:26.779 INFO:tasks.ceph.osd.7:Started 2023-11-24T07:56:26.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:26.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.976+0000 7fda98df5640 1 Processor -- start 2023-11-24T07:56:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.976+0000 7fda98df5640 1 -- start start 2023-11-24T07:56:26.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda98df5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fda940cead0 0x7fda940d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda98df5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda940d1eb0 0x7fda9406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda98df5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940d22c0 con 0x7fda9415d7b0 2023-11-24T07:56:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda98df5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940d17e0 con 0x7fda940d1eb0 2023-11-24T07:56:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda98df5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940cefd0 con 0x7fda940cead0 2023-11-24T07:56:26.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda9259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda9415d7b0 0x7fda940d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33500/0 (socket says 172.21.15.5:33500) 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda9259c640 1 -- 172.21.15.5:0/1219830199 learned_addr learned my addr 172.21.15.5:0/1219830199 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda92d9d640 1 --2- 172.21.15.5:0/1219830199 >> v2:172.21.15.5:3300/0 conn(0x7fda940d1eb0 0x7fda9406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda91d9b640 1 --2- 172.21.15.5:0/1219830199 >> v2:172.21.15.102:3300/0 conn(0x7fda940cead0 0x7fda940d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda92d9d640 1 -- 172.21.15.5:0/1219830199 >> v2:172.21.15.102:3300/0 conn(0x7fda940cead0 msgr2=0x7fda940d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda92d9d640 1 --2- 172.21.15.5:0/1219830199 >> v2:172.21.15.102:3300/0 conn(0x7fda940cead0 0x7fda940d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda92d9d640 1 -- 172.21.15.5:0/1219830199 >> v1:172.21.15.5:6789/0 conn(0x7fda9415d7b0 legacy=0x7fda940d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.980+0000 7fda92d9d640 1 -- 172.21.15.5:0/1219830199 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940cf2b0 con 0x7fda940d1eb0 2023-11-24T07:56:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda92d9d640 1 --2- 172.21.15.5:0/1219830199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940d1eb0 0x7fda9406bed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda9408ba60 tx=0x7fda8c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f461e04ebdfeec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda9159a640 1 -- 172.21.15.5:0/1219830199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a5880 con 0x7fda940d1eb0 2023-11-24T07:56:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda9159a640 1 -- 172.21.15.5:0/1219830199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0a59e0 con 0x7fda940d1eb0 2023-11-24T07:56:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda9159a640 1 -- 172.21.15.5:0/1219830199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a5d70 con 0x7fda940d1eb0 2023-11-24T07:56:26.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- 172.21.15.5:0/1219830199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940d1eb0 msgr2=0x7fda9406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 --2- 172.21.15.5:0/1219830199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940d1eb0 0x7fda9406bed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda9408ba60 tx=0x7fda8c01c7c0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- 172.21.15.5:0/1219830199 shutdown_connections 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 --2- 172.21.15.5:0/1219830199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940d1eb0 0x7fda9406bed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 --2- 172.21.15.5:0/1219830199 >> v2:172.21.15.102:3300/0 conn(0x7fda940cead0 0x7fda940d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- 172.21.15.5:0/1219830199 >> 172.21.15.5:0/1219830199 conn(0x7fda940d33b0 msgr2=0x7fda940d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- 172.21.15.5:0/1219830199 shutdown_connections 2023-11-24T07:56:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- 172.21.15.5:0/1219830199 wait complete. 2023-11-24T07:56:26.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 Processor -- start 2023-11-24T07:56:26.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.984+0000 7fda98df5640 1 -- start start 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 0x7fda941678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda940d1eb0 0x7fda940b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 0x7fda940b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b6660 con 0x7fda940cead0 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda94166e40 con 0x7fda9415d7b0 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda94167120 con 0x7fda940d1eb0 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 0x7fda941678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 0x7fda941678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41120/0 (socket says 172.21.15.5:41120) 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda9259c640 1 -- 172.21.15.5:0/4257543705 learned_addr learned my addr 172.21.15.5:0/4257543705 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 0x7fda940b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda91d9b640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda940d1eb0 0x7fda940b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 -- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda940d1eb0 msgr2=0x7fda940b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda940d1eb0 0x7fda940b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 -- 172.21.15.5:0/4257543705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 msgr2=0x7fda941678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 0x7fda941678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 -- 172.21.15.5:0/4257543705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009a70 con 0x7fda9415d7b0 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda92d9d640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 0x7fda940b72d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ac000 tx=0x7fda8c019560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0b9650 con 0x7fda9415d7b0 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0b97d0 con 0x7fda9415d7b0 2023-11-24T07:56:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94167400 con 0x7fda9415d7b0 2023-11-24T07:56:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0b9b80 con 0x7fda9415d7b0 2023-11-24T07:56:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda940b62f0 con 0x7fda9415d7b0 2023-11-24T07:56:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fda8c0ad440 con 0x7fda9415d7b0 2023-11-24T07:56:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fda8c0c2b20 con 0x7fda9415d7b0 2023-11-24T07:56:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.988+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda940b67d0 con 0x7fda9415d7b0 2023-11-24T07:56:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:26.992+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fda8c0bd020 con 0x7fda9415d7b0 2023-11-24T07:56:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9404e850 con 0x7fda9415d7b0 2023-11-24T07:56:27.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda82ffd640 1 -- 172.21.15.5:0/4257543705 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fda8c0b2070 con 0x7fda9415d7b0 2023-11-24T07:56:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:27.053 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:26.725216+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 msgr2=0x7fda940b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 0x7fda940b72d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ac000 tx=0x7fda8c019560 comp rx=0 tx=0).stop 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 shutdown_connections 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda9415d7b0 0x7fda940b72d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda940d1eb0 0x7fda940b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 --2- 172.21.15.5:0/4257543705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda940cead0 0x7fda941678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 >> 172.21.15.5:0/4257543705 conn(0x7fda940d33b0 msgr2=0x7fda940b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 shutdown_connections 2023-11-24T07:56:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:27.052+0000 7fda98df5640 1 -- 172.21.15.5:0/4257543705 wait complete. 2023-11-24T07:56:27.073 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T07:56:27.073 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T07:56:27.213 INFO:tasks.ceph.mgr.x.smithi102.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T07:56:27.213 INFO:tasks.ceph.mgr.x.smithi102.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T07:56:27.213 INFO:tasks.ceph.mgr.x.smithi102.stderr: from numpy import show_config as show_numpy_config 2023-11-24T07:56:27.223 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T07:56:27.223 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T07:56:27.223 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-11-24T07:56:27.257 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:27.256+0000 7f6c0de24180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T07:56:27.272 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:27.265+0000 7fbe94255180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T07:56:27.398 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:27.396+0000 7f6c0de24180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T07:56:27.406 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:27.401+0000 7fbe94255180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T07:56:27.412 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-24T07:56:27.412+0000 7effa142b640 -1 Falling back to public interface 2023-11-24T07:56:27.420 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-24T07:56:27.420+0000 7f58bb42f640 -1 Falling back to public interface 2023-11-24T07:56:27.428 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-24T07:56:27.428+0000 7f7267eba640 -1 Falling back to public interface 2023-11-24T07:56:27.437 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-24T07:56:27.436+0000 7f48475e8640 -1 Falling back to public interface 2023-11-24T07:56:27.446 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-11-24T07:56:27.441+0000 7f27c885d640 -1 Falling back to public interface 2023-11-24T07:56:27.454 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-11-24T07:56:27.449+0000 7fd9c479f640 -1 Falling back to public interface 2023-11-24T07:56:27.454 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-11-24T07:56:27.449+0000 7f0cf762f640 -1 Falling back to public interface 2023-11-24T07:56:27.482 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-11-24T07:56:27.477+0000 7f55a1004640 -1 Falling back to public interface 2023-11-24T07:56:27.581 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:27.577+0000 7fbe94255180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T07:56:27.590 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:27.588+0000 7f6c0de24180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T07:56:27.653 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:27.649+0000 7fbe94255180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T07:56:27.666 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:27.664+0000 7f6c0de24180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T07:56:27.790 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:27.785+0000 7fbe94255180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T07:56:27.812 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:27.812+0000 7f6c0de24180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T07:56:27.880 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:28.013 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 Processor -- start 2023-11-24T07:56:28.013 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 -- start start 2023-11-24T07:56:28.015 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7b4160c50 0x7fe7b409a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.015 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 0x7fe7b4099a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.015 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b4161300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.016 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b406bba0 con 0x7fe7b4160c50 2023-11-24T07:56:28.016 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b406c720 con 0x7fe7b40cf320 2023-11-24T07:56:28.016 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b89df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b409a3a0 con 0x7fe7b4099f70 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7b4160c50 0x7fe7b409a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7b4160c50 0x7fe7b409a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51090/0 (socket says 172.21.15.5:51090) 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 -- 172.21.15.5:0/2713677963 learned_addr learned my addr 172.21.15.5:0/2713677963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b2d9d640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b4161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7a9d9b640 1 --2- 172.21.15.5:0/2713677963 >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 0x7fe7b4099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 -- 172.21.15.5:0/2713677963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 msgr2=0x7fe7b4161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b4161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 -- 172.21.15.5:0/2713677963 >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 msgr2=0x7fe7b4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:28.018 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 --2- 172.21.15.5:0/2713677963 >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 0x7fe7b4099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.018 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7b259c640 1 -- 172.21.15.5:0/2713677963 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b406bdf0 con 0x7fe7b4160c50 2023-11-24T07:56:28.018 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.012+0000 7fe7a9d9b640 1 --2- 172.21.15.5:0/2713677963 >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 0x7fe7b4099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b259c640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b409a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4071b70 tx=0x7fe7a401c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397886a949c339f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b1d9b640 1 -- 172.21.15.5:0/2713677963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ab600 con 0x7fe7b4160c50 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b1d9b640 1 -- 172.21.15.5:0/2713677963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40a7050 con 0x7fe7b4160c50 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b1d9b640 1 -- 172.21.15.5:0/2713677963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ab980 con 0x7fe7b4160c50 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 -- 172.21.15.5:0/2713677963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 msgr2=0x7fe7b409a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b409a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4071b70 tx=0x7fe7a401c0f0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.019 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 -- 172.21.15.5:0/2713677963 shutdown_connections 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 --2- 172.21.15.5:0/2713677963 >> v2:172.21.15.102:3300/0 conn(0x7fe7b40cf320 0x7fe7b4099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 --2- 172.21.15.5:0/2713677963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b409a800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 -- 172.21.15.5:0/2713677963 >> 172.21.15.5:0/2713677963 conn(0x7fe7b40d12d0 msgr2=0x7fe7b40d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 -- 172.21.15.5:0/2713677963 shutdown_connections 2023-11-24T07:56:28.020 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.016+0000 7fe7b89df640 1 -- 172.21.15.5:0/2713677963 wait complete. 2023-11-24T07:56:28.021 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 Processor -- start 2023-11-24T07:56:28.021 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 -- start start 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 0x7fe7b40c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b414cc00 con 0x7fe7b4160c50 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7690 con 0x7fe7b40cf320 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7970 con 0x7fe7b4099f70 2023-11-24T07:56:28.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 0x7fe7b40c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51096/0 (socket says 172.21.15.5:51096) 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b2d9d640 1 -- 172.21.15.5:0/546573065 learned_addr learned my addr 172.21.15.5:0/546573065 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 -- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 msgr2=0x7fe7b415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b415fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 -- 172.21.15.5:0/546573065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 msgr2=0x7fe7b40c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 -- 172.21.15.5:0/546573065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40094d0 con 0x7fe7b40cf320 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b2d9d640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:28.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7a9d9b640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 0x7fe7b40c63e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007e70 tx=0x7fe79c00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:28.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c003ba0 con 0x7fe7b40cf320 2023-11-24T07:56:28.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00f040 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.020+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40b6860 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00de80 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40b6e20 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe79c004330 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe79c01f440 con 0x7fe7b40cf320 2023-11-24T07:56:28.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b4066db0 con 0x7fe7b40cf320 2023-11-24T07:56:28.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.024+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe79c024060 con 0x7fe7b40cf320 2023-11-24T07:56:28.086 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.084+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b404e850 con 0x7fe7b40cf320 2023-11-24T07:56:28.087 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.084+0000 7fe7ab7fe640 1 -- 172.21.15.5:0/546573065 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe79c01a070 con 0x7fe7b40cf320 2023-11-24T07:56:28.087 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-24T07:56:28.088 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:26.725216+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 msgr2=0x7fe7b40c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 0x7fe7b40c63e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007e70 tx=0x7fe79c00d4a0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 shutdown_connections 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b4160c50 0x7fe7b40c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b40cf320 0x7fe7b40c63e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 --2- 172.21.15.5:0/546573065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7b4099f70 0x7fe7b415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:28.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 >> 172.21.15.5:0/546573065 conn(0x7fe7b40d12d0 msgr2=0x7fe7b40ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:28.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 shutdown_connections 2023-11-24T07:56:28.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:28.088+0000 7fe7b89df640 1 -- 172.21.15.5:0/546573065 wait complete. 2023-11-24T07:56:28.105 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T07:56:28.466 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:28.461+0000 7fbe94255180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T07:56:28.541 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:28.540+0000 7f6c0de24180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T07:56:28.552 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:28.545+0000 7fbe94255180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T07:56:28.632 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:28.632+0000 7f6c0de24180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T07:56:28.742 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:28.737+0000 7fbe94255180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T07:56:28.826 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:28.821+0000 7fbe94255180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T07:56:28.833 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:28.832+0000 7f6c0de24180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T07:56:28.922 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:28.920+0000 7f6c0de24180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T07:56:29.152 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:29.145+0000 7fbe94255180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T07:56:29.219 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:29.213+0000 7fbe94255180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T07:56:29.272 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:29.272+0000 7f6c0de24180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T07:56:29.344 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-24T07:56:29.344+0000 7f6c0de24180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T07:56:30.247 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:30.241+0000 7fbe3b8d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T07:56:30.247 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-11-24T07:56:30.241+0000 7fbe3b8d0640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T07:56:31.300 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-24T07:56:31.300+0000 7effa142b640 -1 osd.2 0 log_to_monitors true 2023-11-24T07:56:31.442 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-24T07:56:31.440+0000 7f58bb42f640 -1 osd.1 0 log_to_monitors true 2023-11-24T07:56:31.442 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-11-24T07:56:31.437+0000 7f0cf762f640 -1 osd.6 0 log_to_monitors true 2023-11-24T07:56:31.457 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-24T07:56:31.456+0000 7f7267eba640 -1 osd.0 0 log_to_monitors true 2023-11-24T07:56:31.459 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-11-24T07:56:31.453+0000 7f55a1004640 -1 osd.7 0 log_to_monitors true 2023-11-24T07:56:31.459 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-11-24T07:56:31.453+0000 7fd9c479f640 -1 osd.5 0 log_to_monitors true 2023-11-24T07:56:31.500 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-24T07:56:31.500+0000 7f48475e8640 -1 osd.3 0 log_to_monitors true 2023-11-24T07:56:31.575 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-11-24T07:56:31.569+0000 7f27c885d640 -1 osd.4 0 log_to_monitors true 2023-11-24T07:56:34.912 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:35.076 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-24T07:56:35.076+0000 7f4842d71640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T07:56:35.122 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-24T07:56:35.120+0000 7f483b3be640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.124 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-24T07:56:35.124+0000 7eff9d9c9640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T07:56:35.131 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.128+0000 7f5050d1c640 1 Processor -- start 2023-11-24T07:56:35.131 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.128+0000 7f5050d1c640 1 -- start start 2023-11-24T07:56:35.133 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5050d1c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f504c0d1a80 0x7f504c0d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.133 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5050d1c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f504c0b6f20 0x7f504c0b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.133 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5050d1c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0d2420 con 0x7f504c160c40 2023-11-24T07:56:35.133 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5050d1c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c0d0ac0 con 0x7f504c0d1a80 2023-11-24T07:56:35.133 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5050d1c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c0b6a90 con 0x7f504c0b6f20 2023-11-24T07:56:35.134 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f7263641640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T07:56:35.134 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5049d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f504c0d1a80 0x7f504c0d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:35.134 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f504a59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f504c160c40 0x7f504c0cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:35280/0 (socket says 172.21.15.5:35280) 2023-11-24T07:56:35.134 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f504a59c640 1 -- 172.21.15.5:0/4279995223 learned_addr learned my addr 172.21.15.5:0/4279995223 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:35.134 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f504ad9d640 1 --2- 172.21.15.5:0/4279995223 >> v2:172.21.15.102:3300/0 conn(0x7f504c0b6f20 0x7f504c0b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:35.135 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5049d9b640 1 -- 172.21.15.5:0/4279995223 >> v2:172.21.15.102:3300/0 conn(0x7f504c0b6f20 msgr2=0x7f504c0b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:35.135 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5049d9b640 1 --2- 172.21.15.5:0/4279995223 >> v2:172.21.15.102:3300/0 conn(0x7f504c0b6f20 0x7f504c0b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.135 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5049d9b640 1 -- 172.21.15.5:0/4279995223 >> v1:172.21.15.102:6789/0 conn(0x7f504c160c40 legacy=0x7f504c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.135 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.132+0000 7f5049d9b640 1 -- 172.21.15.5:0/4279995223 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0d07e0 con 0x7f504c0d1a80 2023-11-24T07:56:35.138 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f5049d9b640 1 --2- 172.21.15.5:0/4279995223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0d1a80 0x7f504c0d1ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f504c0ca520 tx=0x7f504001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d8dbb1351cb26a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:35.139 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f504959a640 1 -- 172.21.15.5:0/4279995223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400ab600 con 0x7f504c0d1a80 2023-11-24T07:56:35.139 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f504959a640 1 -- 172.21.15.5:0/4279995223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50400a7050 con 0x7f504c0d1a80 2023-11-24T07:56:35.139 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f504959a640 1 -- 172.21.15.5:0/4279995223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400ab980 con 0x7f504c0d1a80 2023-11-24T07:56:35.139 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f5050d1c640 1 -- 172.21.15.5:0/4279995223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0d1a80 msgr2=0x7f504c0d1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.140 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.136+0000 7f5050d1c640 1 --2- 172.21.15.5:0/4279995223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0d1a80 0x7f504c0d1ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f504c0ca520 tx=0x7f504001c360 comp rx=0 tx=0).stop 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- 172.21.15.5:0/4279995223 shutdown_connections 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 --2- 172.21.15.5:0/4279995223 >> v2:172.21.15.102:3300/0 conn(0x7f504c0b6f20 0x7f504c0b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 --2- 172.21.15.5:0/4279995223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0d1a80 0x7f504c0d1ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- 172.21.15.5:0/4279995223 >> 172.21.15.5:0/4279995223 conn(0x7f504c08afc0 msgr2=0x7f504c0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- 172.21.15.5:0/4279995223 shutdown_connections 2023-11-24T07:56:35.141 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- 172.21.15.5:0/4279995223 wait complete. 2023-11-24T07:56:35.142 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 Processor -- start 2023-11-24T07:56:35.142 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- start start 2023-11-24T07:56:35.143 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.143 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f504c0d1a80 0x7f504c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f504c160c40 0x7f504c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0c9bc0 con 0x7f504c0b6f20 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c153680 con 0x7f504c0d1a80 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f5050d1c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c1551b0 con 0x7f504c160c40 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f504a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f504a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51142/0 (socket says 172.21.15.5:51142) 2023-11-24T07:56:35.144 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.140+0000 7f504a59c640 1 -- 172.21.15.5:0/3056460891 learned_addr learned my addr 172.21.15.5:0/3056460891 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 -- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f504c160c40 msgr2=0x7f504c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f504c160c40 0x7f504c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 -- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f504c0d1a80 msgr2=0x7f504c152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f504c0d1a80 0x7f504c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 -- 172.21.15.5:0/3056460891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009420 con 0x7f504c0b6f20 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f504a59c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c500 tx=0x7f503c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:35.146 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c005cf0 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c005e50 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c0d05b0 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c007270 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c153310 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c04e850 con 0x7f504c0b6f20 2023-11-24T07:56:35.147 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.144+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f503c0073d0 con 0x7f504c0b6f20 2023-11-24T07:56:35.149 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.148+0000 7f503affd640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 0x7f502c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:35.149 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.148+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f503c082490 con 0x7f504c0b6f20 2023-11-24T07:56:35.149 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.148+0000 7f5049d9b640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 0x7f502c0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:35.150 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.148+0000 7f5049d9b640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 0x7f502c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f50400ad000 tx=0x7f5040004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:35.154 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.152+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f503c050820 con 0x7f504c0b6f20 2023-11-24T07:56:35.170 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-24T07:56:35.168+0000 7eff947e0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.181 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-24T07:56:35.180+0000 7f725bc8e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.195 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-24T07:56:35.192+0000 7f58b6bb8640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T07:56:35.233 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-24T07:56:35.232+0000 7f58af205640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.317 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.316+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f504c0d3f00 con 0x7f504c0b6f20 2023-11-24T07:56:35.318 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.316+0000 7f503affd640 1 -- 172.21.15.5:0/3056460891 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f503c017090 con 0x7f504c0b6f20 2023-11-24T07:56:35.318 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-24T07:56:35.318 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:33.250983+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:35.320 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 msgr2=0x7f502c0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.320 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 0x7f502c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f50400ad000 tx=0x7f5040004740 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 msgr2=0x7f504c141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c500 tx=0x7f503c00c9c0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 shutdown_connections 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f502c0663e0 0x7f502c0688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f504c160c40 0x7f504c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f504c0d1a80 0x7f504c152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 --2- 172.21.15.5:0/3056460891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504c0b6f20 0x7f504c141c00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 >> 172.21.15.5:0/3056460891 conn(0x7f504c08afc0 msgr2=0x7f504c0b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 shutdown_connections 2023-11-24T07:56:35.321 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:35.320+0000 7f5050d1c640 1 -- 172.21.15.5:0/3056460891 wait complete. 2023-11-24T07:56:35.338 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T07:56:35.684 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-11-24T07:56:35.677+0000 7f559c78d640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T07:56:35.689 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-11-24T07:56:35.685+0000 7f0cf2db8640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T07:56:35.706 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-11-24T07:56:35.701+0000 7fd9bff26640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T07:56:35.713 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-11-24T07:56:35.709+0000 7f27c581a640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T07:56:35.713 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-11-24T07:56:35.709+0000 7f5594dda640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.721 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-11-24T07:56:35.717+0000 7f0ceb405640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.733 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-11-24T07:56:35.729+0000 7fd9b8573640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:35.757 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-11-24T07:56:35.753+0000 7f27bc631640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T07:56:42.144 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:42.287 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.284+0000 7fd5ad079640 1 Processor -- start 2023-11-24T07:56:42.287 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.284+0000 7fd5ad079640 1 -- start start 2023-11-24T07:56:42.288 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd5a815b340 0x7fd5a815f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.288 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5a80cb460 0x7fd5a806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80b2ee0 con 0x7fd5a80cb460 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80acb20 con 0x7fd5a815b340 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5ad079640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a815fe70 con 0x7fd5a80cbed0 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5a80cb460 0x7fd5a806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5a80cb460 0x7fd5a806dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53456/0 (socket says 172.21.15.5:53456) 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 -- 172.21.15.5:0/825494821 learned_addr learned my addr 172.21.15.5:0/825494821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a6d9d640 1 --2- 172.21.15.5:0/825494821 >> v2:172.21.15.102:3300/0 conn(0x7fd5a815b340 0x7fd5a815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.289 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a659c640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.290 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 -- 172.21.15.5:0/825494821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 msgr2=0x7fd5a806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:42.290 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a806d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.290 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 -- 172.21.15.5:0/825494821 >> v2:172.21.15.102:3300/0 conn(0x7fd5a815b340 msgr2=0x7fd5a815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:42.290 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 --2- 172.21.15.5:0/825494821 >> v2:172.21.15.102:3300/0 conn(0x7fd5a815b340 0x7fd5a815f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.290 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 -- 172.21.15.5:0/825494821 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80b2260 con 0x7fd5a80cb460 2023-11-24T07:56:42.292 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.288+0000 7fd5a759e640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a806dd70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8072c30 tx=0x7fd5a001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de39509b90da39d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.292 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5a5d9b640 1 -- 172.21.15.5:0/825494821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a5790 con 0x7fd5a80cb460 2023-11-24T07:56:42.292 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5a5d9b640 1 -- 172.21.15.5:0/825494821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a00a58f0 con 0x7fd5a80cb460 2023-11-24T07:56:42.292 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5a5d9b640 1 -- 172.21.15.5:0/825494821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a5c80 con 0x7fd5a80cb460 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- 172.21.15.5:0/825494821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 msgr2=0x7fd5a806dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a806dd70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8072c30 tx=0x7fd5a001c910 comp rx=0 tx=0).stop 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- 172.21.15.5:0/825494821 shutdown_connections 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a806dd70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- 172.21.15.5:0/825494821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a806d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- 172.21.15.5:0/825494821 >> v2:172.21.15.102:3300/0 conn(0x7fd5a815b340 0x7fd5a815f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.294 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- 172.21.15.5:0/825494821 >> 172.21.15.5:0/825494821 conn(0x7fd5a80b0ec0 msgr2=0x7fd5a80b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:42.294 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- 172.21.15.5:0/825494821 shutdown_connections 2023-11-24T07:56:42.294 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- 172.21.15.5:0/825494821 wait complete. 2023-11-24T07:56:42.295 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 Processor -- start 2023-11-24T07:56:42.295 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 -- start start 2023-11-24T07:56:42.297 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.297 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.292+0000 7fd5ad079640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a8070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.297 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5a815b340 0x7fd5a8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.297 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a815a870 con 0x7fd5a80cb460 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80ac410 con 0x7fd5a815b340 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a806c720 con 0x7fd5a80cbed0 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53466/0 (socket says 172.21.15.5:53466) 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 -- 172.21.15.5:0/3334725293 learned_addr learned my addr 172.21.15.5:0/3334725293 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:42.298 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a659c640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a8070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a759e640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5a815b340 0x7fd5a8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 -- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 msgr2=0x7fd5a8070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a8070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 -- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5a815b340 msgr2=0x7fd5a8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5a815b340 0x7fd5a8152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.299 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 -- 172.21.15.5:0/3334725293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0009b30 con 0x7fd5a80cb460 2023-11-24T07:56:42.300 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5a6d9d640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd59800e870 tx=0x7fd59800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598009510 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800eec0 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a806c9c0 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800cb40 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a813b8d0 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a813b730 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.296+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd59800cca0 con 0x7fd5a80cb460 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.300+0000 7fd58f7fe640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 0x7fd594068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.301 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.300+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd598083b40 con 0x7fd5a80cb460 2023-11-24T07:56:42.302 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.300+0000 7fd5a659c640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 0x7fd594068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.302 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.300+0000 7fd5a659c640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 0x7fd594068960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5a806cdc0 tx=0x7fd59c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.304+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5a813b730 con 0x7fd5a80cb460 2023-11-24T07:56:42.462 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.460+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5a813b730 con 0x7fd5a80cb460 2023-11-24T07:56:42.463 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.460+0000 7fd58f7fe640 1 -- 172.21.15.5:0/3334725293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fd5a813b730 con 0x7fd5a80cb460 2023-11-24T07:56:42.463 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-24T07:56:42.463 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:39.306032+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 msgr2=0x7fd594068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 0x7fd594068960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5a806cdc0 tx=0x7fd59c009190 comp rx=0 tx=0).stop 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 msgr2=0x7fd5a8164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd59800e870 tx=0x7fd59800ec70 comp rx=0 tx=0).stop 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 shutdown_connections 2023-11-24T07:56:42.465 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd5940664a0 0x7fd594068960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5a815b340 0x7fd5a8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5a80cbed0 0x7fd5a8070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 --2- 172.21.15.5:0/3334725293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5a80cb460 0x7fd5a8164490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 >> 172.21.15.5:0/3334725293 conn(0x7fd5a80b0ec0 msgr2=0x7fd5a81573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 shutdown_connections 2023-11-24T07:56:42.466 INFO:teuthology.misc.health.smithi005.stderr:2023-11-24T07:56:42.464+0000 7fd5ad079640 1 -- 172.21.15.5:0/3334725293 wait complete. 2023-11-24T07:56:42.482 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T07:56:42.483 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T07:56:42.483 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T07:56:42.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T07:56:42.487 INFO:tasks.ceph.mds.a:Started 2023-11-24T07:56:42.487 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T07:56:42.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T07:56:42.490 INFO:tasks.ceph.mds.c:Started 2023-11-24T07:56:42.491 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T07:56:42.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T07:56:42.495 INFO:tasks.ceph.mds.b:Started 2023-11-24T07:56:42.495 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T07:56:42.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T07:56:42.498 INFO:tasks.ceph.mds.d:Started 2023-11-24T07:56:42.499 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T07:56:42.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:42.591 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-11-24T07:56:42.592 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-11-24T07:56:42.595 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2023-11-24T07:56:42.597 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2023-11-24T07:56:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 Processor -- start 2023-11-24T07:56:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 -- start start 2023-11-24T07:56:42.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 0x7f961806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180ae7f0 con 0x7f9618143ae0 2023-11-24T07:56:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961806e980 con 0x7f961806dfd0 2023-11-24T07:56:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f96200e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618070670 con 0x7f96180ae3d0 2023-11-24T07:56:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f961de7f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9618143ae0 0x7f96180b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34842/0 (socket says 172.21.15.5:34842) 2023-11-24T07:56:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f961de7f640 1 -- 172.21.15.5:0/148747610 learned_addr learned my addr 172.21.15.5:0/148747610 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.648+0000 7f961e680640 1 --2- 172.21.15.5:0/148747610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 0x7f961806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259123686 0 0) 0x7f96180ae7f0 con 0x7f9618143ae0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9604003530 con 0x7f9618143ae0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392295631 0 0) 0x7f961806e980 con 0x7f961806dfd0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96180ae7f0 con 0x7f961806dfd0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212256326 0 0) 0x7f9604003530 con 0x7f9618143ae0 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961e680640 1 -- 172.21.15.5:0/148747610 >> v1:172.21.15.102:6789/0 conn(0x7f961806dfd0 legacy=0x7f96180adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961e680640 1 -- 172.21.15.5:0/148747610 >> v1:172.21.15.5:6789/0 conn(0x7f9618143ae0 legacy=0x7f96180b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961e680640 1 -- 172.21.15.5:0/148747610 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618070950 con 0x7f96180ae3d0 2023-11-24T07:56:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961e680640 1 --2- 172.21.15.5:0/148747610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 0x7f961806e440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9610009dc0 tx=0x7f961001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0149fe533cbcd1f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614001680 con 0x7f96180ae3d0 2023-11-24T07:56:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100a56a0 con 0x7f96180ae3d0 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.652+0000 7f961ce7d640 1 -- 172.21.15.5:0/148747610 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a5a30 con 0x7f96180ae3d0 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- 172.21.15.5:0/148747610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 msgr2=0x7f961806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 --2- 172.21.15.5:0/148747610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 0x7f961806e440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9610009dc0 tx=0x7f961001c860 comp rx=0 tx=0).stop 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- 172.21.15.5:0/148747610 shutdown_connections 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 --2- 172.21.15.5:0/148747610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96180ae3d0 0x7f961806e440 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- 172.21.15.5:0/148747610 >> 172.21.15.5:0/148747610 conn(0x7f96180b0c40 msgr2=0x7f96180b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- 172.21.15.5:0/148747610 shutdown_connections 2023-11-24T07:56:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- 172.21.15.5:0/148747610 wait complete. 2023-11-24T07:56:42.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 Processor -- start 2023-11-24T07:56:42.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- start start 2023-11-24T07:56:42.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 0x7f9618155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9618143ae0 0x7f961815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618159160 con 0x7f961806dfd0 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618158ba0 con 0x7f96180ae3d0 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f96200e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618158e80 con 0x7f9618143ae0 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961d67e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 0x7f9618155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53504/0 (socket says 172.21.15.5:53504) 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 -- 172.21.15.5:0/2676106539 learned_addr learned my addr 172.21.15.5:0/2676106539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961e680640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9618143ae0 0x7f961815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 -- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9618143ae0 msgr2=0x7f961815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9618143ae0 0x7f961815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 -- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 msgr2=0x7f9618155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 0x7f9618155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961de7f640 1 -- 172.21.15.5:0/2676106539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009a70 con 0x7f961806dfd0 2023-11-24T07:56:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.656+0000 7f961d67e640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 0x7f9618155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f961de7f640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f961400c780 tx=0x7f961400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614005ae0 con 0x7f961806dfd0 2023-11-24T07:56:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614005c60 con 0x7f961806dfd0 2023-11-24T07:56:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9618159470 con 0x7f961806dfd0 2023-11-24T07:56:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614007070 con 0x7f961806dfd0 2023-11-24T07:56:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9618159c70 con 0x7f961806dfd0 2023-11-24T07:56:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961809d110 con 0x7f961806dfd0 2023-11-24T07:56:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96140071d0 con 0x7f961806dfd0 2023-11-24T07:56:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 0x7f95fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96140831d0 con 0x7f961806dfd0 2023-11-24T07:56:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.660+0000 7f961d67e640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 0x7f95fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.664+0000 7f961d67e640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 0x7f95fc068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f961813cce0 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.664+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9614050a40 con 0x7f961806dfd0 2023-11-24T07:56:42.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961804e850 con 0x7f961806dfd0 2023-11-24T07:56:42.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f960e7fc640 1 -- 172.21.15.5:0/2676106539 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f9614054060 con 0x7f961806dfd0 2023-11-24T07:56:42.830 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:42.830 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:39.306032+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 msgr2=0x7f95fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 0x7f95fc068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f961813cce0 tx=0x7f9608009040 comp rx=0 tx=0).stop 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 msgr2=0x7f961815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f961400c780 tx=0x7f961400cc40 comp rx=0 tx=0).stop 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 shutdown_connections 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f95fc066470 0x7f95fc068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9618143ae0 0x7f961815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96180ae3d0 0x7f9618155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 --2- 172.21.15.5:0/2676106539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961806dfd0 0x7f961815d650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 >> 172.21.15.5:0/2676106539 conn(0x7f96180b0c40 msgr2=0x7f96180b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 shutdown_connections 2023-11-24T07:56:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.828+0000 7f96200e3640 1 -- 172.21.15.5:0/2676106539 wait complete. 2023-11-24T07:56:42.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:56:42.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:56:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 Processor -- start 2023-11-24T07:56:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 -- start start 2023-11-24T07:56:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f815d610 0x7f27f80ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f806c520 0x7f27f806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f806ceb0 con 0x7f27f80caa60 2023-11-24T07:56:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80caef0 con 0x7f27f815d610 2023-11-24T07:56:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f28002c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80cbfe0 con 0x7f27f806c520 2023-11-24T07:56:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f815d610 0x7f27f80ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f815d610 0x7f27f80ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53508/0 (socket says 172.21.15.5:53508) 2023-11-24T07:56:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 -- 172.21.15.5:0/3089658081 learned_addr learned my addr 172.21.15.5:0/3089658081 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe866640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f806c520 0x7f27f806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 -- 172.21.15.5:0/3089658081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f806c520 msgr2=0x7f27f806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f806c520 0x7f27f806c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 -- 172.21.15.5:0/3089658081 >> v1:172.21.15.102:6789/0 conn(0x7f27f80caa60 legacy=0x7f27f80cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:42.996+0000 7f27fe065640 1 -- 172.21.15.5:0/3089658081 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f806b970 con 0x7f27f815d610 2023-11-24T07:56:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f27fe065640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f815d610 0x7f27f80ce4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009870 tx=0x7f27f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85479b6dab3e4a68 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f27fd063640 1 -- 172.21.15.5:0/3089658081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40aa670 con 0x7f27f815d610 2023-11-24T07:56:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f27fd063640 1 -- 172.21.15.5:0/3089658081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f40aa7d0 con 0x7f27f815d610 2023-11-24T07:56:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f27fd063640 1 -- 172.21.15.5:0/3089658081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40aab60 con 0x7f27f815d610 2023-11-24T07:56:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 -- 172.21.15.5:0/3089658081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f815d610 msgr2=0x7f27f80ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f815d610 0x7f27f80ce4b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009870 tx=0x7f27f401c510 comp rx=0 tx=0).stop 2023-11-24T07:56:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 -- 172.21.15.5:0/3089658081 shutdown_connections 2023-11-24T07:56:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f806c520 0x7f27f806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 --2- 172.21.15.5:0/3089658081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f815d610 0x7f27f80ce4b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 -- 172.21.15.5:0/3089658081 >> 172.21.15.5:0/3089658081 conn(0x7f27f80b2f10 msgr2=0x7f27f80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 -- 172.21.15.5:0/3089658081 shutdown_connections 2023-11-24T07:56:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.000+0000 7f28002c9640 1 -- 172.21.15.5:0/3089658081 wait complete. 2023-11-24T07:56:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 Processor -- start 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- start start 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f80caa60 0x7f27f81606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f815d610 0x7f27f81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b4140 con 0x7f27f806c520 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b4420 con 0x7f27f80caa60 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b4700 con 0x7f27f815d610 2023-11-24T07:56:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53518/0 (socket says 172.21.15.5:53518) 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 -- 172.21.15.5:0/2551250435 learned_addr learned my addr 172.21.15.5:0/2551250435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe866640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f815d610 0x7f27f81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fd864640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f80caa60 0x7f27f81606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 -- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f815d610 msgr2=0x7f27f81576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f815d610 0x7f27f81576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 -- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f80caa60 msgr2=0x7f27f81606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f80caa60 0x7f27f81606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 -- 172.21.15.5:0/2551250435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40094d0 con 0x7f27f806c520 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27fe065640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ac040 tx=0x7f27f401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40b3800 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f40b3960 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80b3dd0 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40b3d10 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.004+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f8151260 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f804e850 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27f40c6390 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f27eeffd640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27f411e670 con 0x7f27f806c520 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f27fd864640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.008+0000 7f27fd864640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 0x7f27dc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27f8156fb0 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.012+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27f40ebe50 con 0x7f27f806c520 2023-11-24T07:56:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f8154fa0 con 0x7f27f806c520 2023-11-24T07:56:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f27eeffd640 1 -- 172.21.15.5:0/2551250435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27f40ef470 con 0x7f27f806c520 2023-11-24T07:56:43.173 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:56:43.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 msgr2=0x7f27dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 0x7f27dc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27f8156fb0 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 msgr2=0x7f27f8150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ac040 tx=0x7f27f401ad50 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 shutdown_connections 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f27dc066470 0x7f27dc068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27f815d610 0x7f27f81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f80caa60 0x7f27f81606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 --2- 172.21.15.5:0/2551250435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f806c520 0x7f27f8150d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 >> 172.21.15.5:0/2551250435 conn(0x7f27f80b2f10 msgr2=0x7f27f8153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 shutdown_connections 2023-11-24T07:56:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.172+0000 7f28002c9640 1 -- 172.21.15.5:0/2551250435 wait complete. 2023-11-24T07:56:43.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:56:43.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 Processor -- start 2023-11-24T07:56:43.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 -- start start 2023-11-24T07:56:43.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa24006e410 0x7fa2400715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2400adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2400ad740 con 0x7fa240071af0 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400b3e20 con 0x7fa24006e410 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa244f8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa240071fa0 con 0x7fa2400b30b0 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa23e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa24006e410 0x7fa2400715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa23e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa24006e410 0x7fa2400715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53532/0 (socket says 172.21.15.5:53532) 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa23e59c640 1 -- 172.21.15.5:0/3153138094 learned_addr learned my addr 172.21.15.5:0/3153138094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:43.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.336+0000 7fa23ed9d640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2400adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23e59c640 1 -- 172.21.15.5:0/3153138094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 msgr2=0x7fa2400adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:43.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23e59c640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2400adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23e59c640 1 -- 172.21.15.5:0/3153138094 >> v1:172.21.15.102:6789/0 conn(0x7fa240071af0 legacy=0x7fa2400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23e59c640 1 -- 172.21.15.5:0/3153138094 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400b3580 con 0x7fa24006e410 2023-11-24T07:56:43.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23dd9b640 1 -- 172.21.15.5:0/3153138094 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657125413 0 0) 0x7fa2400ad740 con 0x7fa240071af0 2023-11-24T07:56:43.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23e59c640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa2400715b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2300098a0 tx=0x7fa23001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20ba4258c5ffadf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23dd9b640 1 -- 172.21.15.5:0/3153138094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300ab610 con 0x7fa24006e410 2023-11-24T07:56:43.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23dd9b640 1 -- 172.21.15.5:0/3153138094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300ab770 con 0x7fa24006e410 2023-11-24T07:56:43.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa23dd9b640 1 -- 172.21.15.5:0/3153138094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300abb00 con 0x7fa24006e410 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 -- 172.21.15.5:0/3153138094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 msgr2=0x7fa2400715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa2400715b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2300098a0 tx=0x7fa23001c520 comp rx=0 tx=0).stop 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 -- 172.21.15.5:0/3153138094 shutdown_connections 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2400adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3153138094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa2400715b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 -- 172.21.15.5:0/3153138094 >> 172.21.15.5:0/3153138094 conn(0x7fa2400b1e40 msgr2=0x7fa240070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 -- 172.21.15.5:0/3153138094 shutdown_connections 2023-11-24T07:56:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.340+0000 7fa244f8d640 1 -- 172.21.15.5:0/3153138094 wait complete. 2023-11-24T07:56:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 Processor -- start 2023-11-24T07:56:43.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 -- start start 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa240071af0 0x7fa240153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2401535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24013bf30 con 0x7fa24006e410 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24013bab0 con 0x7fa240071af0 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa244f8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24013c110 con 0x7fa2400b30b0 2023-11-24T07:56:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53534/0 (socket says 172.21.15.5:53534) 2023-11-24T07:56:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 -- 172.21.15.5:0/3281235158 learned_addr learned my addr 172.21.15.5:0/3281235158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa237fff640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa240071af0 0x7fa240153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23ed9d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2401535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 -- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 msgr2=0x7fa2401535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2401535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 -- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa240071af0 msgr2=0x7fa240153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa240071af0 0x7fa240153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 -- 172.21.15.5:0/3281235158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300094d0 con 0x7fa24006e410 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23ed9d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2401535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.344+0000 7fa23e59c640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2300ad040 tx=0x7fa23001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b4800 con 0x7fa24006e410 2023-11-24T07:56:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300b4960 con 0x7fa24006e410 2023-11-24T07:56:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b4d10 con 0x7fa24006e410 2023-11-24T07:56:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24013c3f0 con 0x7fa24006e410 2023-11-24T07:56:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24013c9b0 con 0x7fa24006e410 2023-11-24T07:56:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24004e850 con 0x7fa24006e410 2023-11-24T07:56:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2300b3380 con 0x7fa24006e410 2023-11-24T07:56:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 0x7fa220068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa23011e150 con 0x7fa24006e410 2023-11-24T07:56:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa237fff640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 0x7fa220068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.348+0000 7fa237fff640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 0x7fa220068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa24013f150 tx=0x7fa228009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.352+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2300eb8a0 con 0x7fa24006e410 2023-11-24T07:56:43.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa24006bbe0 con 0x7fa24006e410 2023-11-24T07:56:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa236ffd640 1 -- 172.21.15.5:0/3281235158 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7fa2300eeec0 con 0x7fa24006e410 2023-11-24T07:56:43.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:43.545 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T07:56:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 msgr2=0x7fa220068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 0x7fa220068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa24013f150 tx=0x7fa228009040 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 msgr2=0x7fa24014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2300ad040 tx=0x7fa23001ad60 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 shutdown_connections 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa220066470 0x7fa220068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2400b30b0 0x7fa2401535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa240071af0 0x7fa240153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 --2- 172.21.15.5:0/3281235158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24006e410 0x7fa24014cdb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 >> 172.21.15.5:0/3281235158 conn(0x7fa2400b1e40 msgr2=0x7fa2400cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 shutdown_connections 2023-11-24T07:56:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:43.544+0000 7fa244f8d640 1 -- 172.21.15.5:0/3281235158 wait complete. 2023-11-24T07:56:43.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:56:43.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:56:45.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:56:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.715+0000 7ff03c50e640 1 Processor -- start 2023-11-24T07:56:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.715+0000 7ff03c50e640 1 -- start start 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03c50e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03406dfd0 0x7ff03406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03c50e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff0340adcc0 0x7ff0340ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03c50e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03406e980 con 0x7ff034143ae0 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03c50e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff034070670 con 0x7ff03406dfd0 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03c50e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff034070950 con 0x7ff0340adcc0 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03406dfd0 0x7ff03406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03406dfd0 0x7ff03406e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53548/0 (socket says 172.21.15.5:53548) 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 -- 172.21.15.5:0/4068770873 learned_addr learned my addr 172.21.15.5:0/4068770873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff03aaab640 1 --2- 172.21.15.5:0/4068770873 >> v2:172.21.15.102:3300/0 conn(0x7ff0340adcc0 0x7ff0340ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 -- 172.21.15.5:0/4068770873 >> v2:172.21.15.102:3300/0 conn(0x7ff0340adcc0 msgr2=0x7ff0340ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 --2- 172.21.15.5:0/4068770873 >> v2:172.21.15.102:3300/0 conn(0x7ff0340adcc0 0x7ff0340ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 -- 172.21.15.5:0/4068770873 >> v1:172.21.15.102:6789/0 conn(0x7ff034143ae0 legacy=0x7ff0340b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.719+0000 7ff039aa9640 1 -- 172.21.15.5:0/4068770873 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034070c30 con 0x7ff03406dfd0 2023-11-24T07:56:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff039aa9640 1 --2- 172.21.15.5:0/4068770873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03406dfd0 0x7ff03406e440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff034072ad0 tx=0x7ff02401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9445d27996e56741 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff0392a8640 1 -- 172.21.15.5:0/4068770873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240aa430 con 0x7ff03406dfd0 2023-11-24T07:56:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff0392a8640 1 -- 172.21.15.5:0/4068770873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0240aa590 con 0x7ff03406dfd0 2023-11-24T07:56:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff0392a8640 1 -- 172.21.15.5:0/4068770873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240aa920 con 0x7ff03406dfd0 2023-11-24T07:56:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 -- 172.21.15.5:0/4068770873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03406dfd0 msgr2=0x7ff03406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 --2- 172.21.15.5:0/4068770873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03406dfd0 0x7ff03406e440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff034072ad0 tx=0x7ff02401c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 -- 172.21.15.5:0/4068770873 shutdown_connections 2023-11-24T07:56:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 --2- 172.21.15.5:0/4068770873 >> v2:172.21.15.102:3300/0 conn(0x7ff0340adcc0 0x7ff0340ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 --2- 172.21.15.5:0/4068770873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03406dfd0 0x7ff03406e440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 -- 172.21.15.5:0/4068770873 >> 172.21.15.5:0/4068770873 conn(0x7ff0340b0c40 msgr2=0x7ff0340b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 -- 172.21.15.5:0/4068770873 shutdown_connections 2023-11-24T07:56:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 -- 172.21.15.5:0/4068770873 wait complete. 2023-11-24T07:56:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.723+0000 7ff03c50e640 1 Processor -- start 2023-11-24T07:56:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- start start 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 0x7ff0340b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0340adcc0 0x7ff0341347d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415b600 con 0x7ff034143ae0 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034134d10 con 0x7ff03406dfd0 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415a9f0 con 0x7ff0340adcc0 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53552/0 (socket says 172.21.15.5:53552) 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 -- 172.21.15.5:0/304286340 learned_addr learned my addr 172.21.15.5:0/304286340 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff039aa9640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0340adcc0 0x7ff0341347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03a2aa640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 0x7ff0340b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 -- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0340adcc0 msgr2=0x7ff0341347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0340adcc0 0x7ff0341347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 -- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 msgr2=0x7ff0340b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 0x7ff0340b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 -- 172.21.15.5:0/304286340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240094d0 con 0x7ff034143ae0 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03a2aa640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 0x7ff0340b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03aaab640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff02c007e40 tx=0x7ff02c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c014620 con 0x7ff034143ae0 2023-11-24T07:56:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c00ee90 con 0x7ff034143ae0 2023-11-24T07:56:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0149e0 con 0x7ff034143ae0 2023-11-24T07:56:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03415acd0 con 0x7ff034143ae0 2023-11-24T07:56:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03415b290 con 0x7ff034143ae0 2023-11-24T07:56:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.727+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034067900 con 0x7ff034143ae0 2023-11-24T07:56:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.731+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff02c014b40 con 0x7ff034143ae0 2023-11-24T07:56:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.731+0000 7ff02affd640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 0x7ff018068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.731+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff02c084430 con 0x7ff034143ae0 2023-11-24T07:56:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.731+0000 7ff03a2aa640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 0x7ff018068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.731+0000 7ff03a2aa640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 0x7ff018068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff030000f70 tx=0x7ff030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.735+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff02c051bf0 con 0x7ff034143ae0 2023-11-24T07:56:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.923+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0340ad420 con 0x7ff034143ae0 2023-11-24T07:56:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff02affd640 1 -- 172.21.15.5:0/304286340 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7ff02c055210 con 0x7ff034143ae0 2023-11-24T07:56:45.928 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:45.929 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T07:56:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-11-24T07:56:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 msgr2=0x7ff018068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 0x7ff018068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff030000f70 tx=0x7ff030009040 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 msgr2=0x7ff03409bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff02c007e40 tx=0x7ff02c00e4b0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 shutdown_connections 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff018066470 0x7ff018068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034143ae0 0x7ff03409bc00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0340adcc0 0x7ff0341347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 --2- 172.21.15.5:0/304286340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03406dfd0 0x7ff0340b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 >> 172.21.15.5:0/304286340 conn(0x7ff0340b0c40 msgr2=0x7ff0340aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:45.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 shutdown_connections 2023-11-24T07:56:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:45.927+0000 7ff03c50e640 1 -- 172.21.15.5:0/304286340 wait complete. 2023-11-24T07:56:45.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:46.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 Processor -- start 2023-11-24T07:56:46.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 -- start start 2023-11-24T07:56:46.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f725015d7b0 0x7f72500d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 0x7f725006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500cefd0 con 0x7f72500cead0 2023-11-24T07:56:46.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500cf2b0 con 0x7f725015d7b0 2023-11-24T07:56:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f7254c06640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725006b3f0 con 0x7f72500d2080 2023-11-24T07:56:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f725015d7b0 0x7f72500d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72500cead0 0x7f72500d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34858/0 (socket says 172.21.15.5:34858) 2023-11-24T07:56:46.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724dd9b640 1 -- 172.21.15.5:0/1558039179 learned_addr learned my addr 172.21.15.5:0/1558039179 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:46.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724ed9d640 1 --2- 172.21.15.5:0/1558039179 >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 0x7f725006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724e59c640 1 -- 172.21.15.5:0/1558039179 >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 msgr2=0x7f725006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:46.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724e59c640 1 --2- 172.21.15.5:0/1558039179 >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 0x7f725006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724e59c640 1 -- 172.21.15.5:0/1558039179 >> v1:172.21.15.5:6789/0 conn(0x7f72500cead0 legacy=0x7f72500d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724e59c640 1 -- 172.21.15.5:0/1558039179 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725006b6d0 con 0x7f725015d7b0 2023-11-24T07:56:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.091+0000 7f724ed9d640 1 --2- 172.21.15.5:0/1558039179 >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 0x7f725006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f724e59c640 1 --2- 172.21.15.5:0/1558039179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f725015d7b0 0x7f72500d10d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f725008c870 tx=0x7f724001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab6cb49c2e00ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f724d59a640 1 -- 172.21.15.5:0/1558039179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400ab600 con 0x7f725015d7b0 2023-11-24T07:56:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f724d59a640 1 -- 172.21.15.5:0/1558039179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400a7050 con 0x7f725015d7b0 2023-11-24T07:56:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f724d59a640 1 -- 172.21.15.5:0/1558039179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400ab980 con 0x7f725015d7b0 2023-11-24T07:56:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 -- 172.21.15.5:0/1558039179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f725015d7b0 msgr2=0x7f72500d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 --2- 172.21.15.5:0/1558039179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f725015d7b0 0x7f72500d10d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f725008c870 tx=0x7f724001c310 comp rx=0 tx=0).stop 2023-11-24T07:56:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 -- 172.21.15.5:0/1558039179 shutdown_connections 2023-11-24T07:56:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 --2- 172.21.15.5:0/1558039179 >> v2:172.21.15.102:3300/0 conn(0x7f72500d2080 0x7f725006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 --2- 172.21.15.5:0/1558039179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f725015d7b0 0x7f72500d10d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 -- 172.21.15.5:0/1558039179 >> 172.21.15.5:0/1558039179 conn(0x7f72500d33b0 msgr2=0x7f72500d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 -- 172.21.15.5:0/1558039179 shutdown_connections 2023-11-24T07:56:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.095+0000 7f7254c06640 1 -- 172.21.15.5:0/1558039179 wait complete. 2023-11-24T07:56:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 Processor -- start 2023-11-24T07:56:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- start start 2023-11-24T07:56:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72500d2080 0x7f72500c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 0x7f72500c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b7d90 con 0x7f72500cead0 2023-11-24T07:56:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b8070 con 0x7f725015d7b0 2023-11-24T07:56:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b8350 con 0x7f72500d2080 2023-11-24T07:56:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53570/0 (socket says 172.21.15.5:53570) 2023-11-24T07:56:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 -- 172.21.15.5:0/611446212 learned_addr learned my addr 172.21.15.5:0/611446212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 -- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72500d2080 msgr2=0x7f72500c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72500d2080 0x7f72500c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 -- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 msgr2=0x7f72500c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724ed9d640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 0x7f72500c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 0x7f72500c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 -- 172.21.15.5:0/611446212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009420 con 0x7f72500cead0 2023-11-24T07:56:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724ed9d640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 0x7f72500c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f724e59c640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72400ae040 tx=0x7f72400190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400b4610 con 0x7f72500cead0 2023-11-24T07:56:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400b4770 con 0x7f72500cead0 2023-11-24T07:56:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500b8630 con 0x7f72500cead0 2023-11-24T07:56:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400b4b20 con 0x7f72500cead0 2023-11-24T07:56:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72500b8bf0 con 0x7f72500cead0 2023-11-24T07:56:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.099+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725004e850 con 0x7f72500cead0 2023-11-24T07:56:46.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.103+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72400b2040 con 0x7f72500cead0 2023-11-24T07:56:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.103+0000 7f723effd640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 0x7f7230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.103+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f724011dde0 con 0x7f72500cead0 2023-11-24T07:56:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.103+0000 7f724dd9b640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 0x7f7230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.103+0000 7f724dd9b640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 0x7f7230068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72500d1fc0 tx=0x7f7244007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.107+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72400eb510 con 0x7f72500cead0 2023-11-24T07:56:46.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.263+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72500b91c0 con 0x7f72500cead0 2023-11-24T07:56:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.263+0000 7f723effd640 1 -- 172.21.15.5:0/611446212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f72400b0020 con 0x7f72500cead0 2023-11-24T07:56:46.268 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:46.269 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:39.306032+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 msgr2=0x7f7230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 0x7f7230068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72500d1fc0 tx=0x7f7244007a50 comp rx=0 tx=0).stop 2023-11-24T07:56:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 msgr2=0x7f72500b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72400ae040 tx=0x7f72400190b0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 shutdown_connections 2023-11-24T07:56:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7230066470 0x7f7230068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f725015d7b0 0x7f72500c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72500d2080 0x7f72500c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 --2- 172.21.15.5:0/611446212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72500cead0 0x7f72500b3490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 >> 172.21.15.5:0/611446212 conn(0x7f72500d33b0 msgr2=0x7f725015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 shutdown_connections 2023-11-24T07:56:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.267+0000 7f7254c06640 1 -- 172.21.15.5:0/611446212 wait complete. 2023-11-24T07:56:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:56:46.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:56:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.431+0000 7f8220216640 1 Processor -- start 2023-11-24T07:56:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 -- start start 2023-11-24T07:56:46.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f821806e3f0 0x7f821815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180ce5d0 0x7f821815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8218159630 con 0x7f82180cb9b0 2023-11-24T07:56:46.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821806e860 con 0x7f821806e3f0 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f8220216640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821815bba0 con 0x7f82180ce5d0 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f821806e3f0 0x7f821815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f821806e3f0 0x7f821815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53572/0 (socket says 172.21.15.5:53572) 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 -- 172.21.15.5:0/3078304499 learned_addr learned my addr 172.21.15.5:0/3078304499 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821e7b3640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180ce5d0 0x7f821815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 -- 172.21.15.5:0/3078304499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180ce5d0 msgr2=0x7f821815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180ce5d0 0x7f821815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 -- 172.21.15.5:0/3078304499 >> v1:172.21.15.102:6789/0 conn(0x7f82180cb9b0 legacy=0x7f82180cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.435+0000 7f821d7b1640 1 -- 172.21.15.5:0/3078304499 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821815f6d0 con 0x7f821806e3f0 2023-11-24T07:56:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f821d7b1640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821806e3f0 0x7f821815f190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8208009870 tx=0x7f820801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c7a105731cc145 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f821cfb0640 1 -- 172.21.15.5:0/3078304499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ab610 con 0x7f821806e3f0 2023-11-24T07:56:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f821cfb0640 1 -- 172.21.15.5:0/3078304499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080ab770 con 0x7f821806e3f0 2023-11-24T07:56:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f821cfb0640 1 -- 172.21.15.5:0/3078304499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080abb00 con 0x7f821806e3f0 2023-11-24T07:56:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 -- 172.21.15.5:0/3078304499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821806e3f0 msgr2=0x7f821815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821806e3f0 0x7f821815f190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8208009870 tx=0x7f820801c540 comp rx=0 tx=0).stop 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 -- 172.21.15.5:0/3078304499 shutdown_connections 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180ce5d0 0x7f821815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 --2- 172.21.15.5:0/3078304499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f821806e3f0 0x7f821815f190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 -- 172.21.15.5:0/3078304499 >> 172.21.15.5:0/3078304499 conn(0x7f82180b0cb0 msgr2=0x7f82180b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 -- 172.21.15.5:0/3078304499 shutdown_connections 2023-11-24T07:56:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 -- 172.21.15.5:0/3078304499 wait complete. 2023-11-24T07:56:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.439+0000 7f8220216640 1 Processor -- start 2023-11-24T07:56:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- start start 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821806e3f0 0x7f82180b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 0x7f82181448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180b39e0 con 0x7f82180ce5d0 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180b2770 con 0x7f821806e3f0 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8218157780 con 0x7f82180cb9b0 2023-11-24T07:56:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53574/0 (socket says 172.21.15.5:53574) 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 -- 172.21.15.5:0/3252362642 learned_addr learned my addr 172.21.15.5:0/3252362642 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821d7b1640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 0x7f82181448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821dfb2640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821806e3f0 0x7f82180b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 -- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 msgr2=0x7f82181448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 0x7f82181448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 -- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821806e3f0 msgr2=0x7f82180b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821806e3f0 0x7f82180b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 -- 172.21.15.5:0/3252362642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080094d0 con 0x7f82180ce5d0 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821d7b1640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 0x7f82181448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f821e7b3640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f821000efc0 tx=0x7f821000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210009ba0 con 0x7f82180ce5d0 2023-11-24T07:56:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821000f040 con 0x7f82180ce5d0 2023-11-24T07:56:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180b29c0 con 0x7f82180ce5d0 2023-11-24T07:56:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100146c0 con 0x7f82180ce5d0 2023-11-24T07:56:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82180b2f80 con 0x7f82180ce5d0 2023-11-24T07:56:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.443+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180671f0 con 0x7f82180ce5d0 2023-11-24T07:56:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.447+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8210014820 con 0x7f82180ce5d0 2023-11-24T07:56:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.447+0000 7f820e7fc640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.447+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82100845c0 con 0x7f82180ce5d0 2023-11-24T07:56:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.447+0000 7f821dfb2640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.447+0000 7f821dfb2640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 0x7f81fc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8214007fd0 tx=0x7f8214009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.451+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8210051cf0 con 0x7f82180ce5d0 2023-11-24T07:56:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.607+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f821806b460 con 0x7f82180ce5d0 2023-11-24T07:56:46.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.607+0000 7f820e7fc640 1 -- 172.21.15.5:0/3252362642 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82100180a0 con 0x7f82180ce5d0 2023-11-24T07:56:46.612 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:56:46.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 msgr2=0x7f81fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 0x7f81fc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8214007fd0 tx=0x7f8214009040 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 msgr2=0x7f8218156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f821000efc0 tx=0x7f821000c490 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 shutdown_connections 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180ce5d0 0x7f8218156ce0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82180cb9b0 0x7f82181448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 --2- 172.21.15.5:0/3252362642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821806e3f0 0x7f82180b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 >> 172.21.15.5:0/3252362642 conn(0x7f82180b0cb0 msgr2=0x7f82181646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 shutdown_connections 2023-11-24T07:56:46.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.611+0000 7f8220216640 1 -- 172.21.15.5:0/3252362642 wait complete. 2023-11-24T07:56:46.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T07:56:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 Processor -- start 2023-11-24T07:56:46.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 -- start start 2023-11-24T07:56:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4cc40d1c70 0x7f4cc40d3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cc40d1310 0x7f4cc40cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc40d17f0 con 0x7f4cc40cf3c0 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40ce0c0 con 0x7f4cc40d1310 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc9380640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40ce3a0 con 0x7f4cc40d1c70 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4cc40cf3c0 0x7f4cc41608a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34866/0 (socket says 172.21.15.5:34866) 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cc40d1310 0x7f4cc40cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc37fe640 1 -- 172.21.15.5:0/2707795443 learned_addr learned my addr 172.21.15.5:0/2707795443 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc2ffd640 1 --2- 172.21.15.5:0/2707795443 >> v2:172.21.15.102:3300/0 conn(0x7f4cc40d1c70 0x7f4cc40d3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc27fc640 1 -- 172.21.15.5:0/2707795443 >> v2:172.21.15.102:3300/0 conn(0x7f4cc40d1c70 msgr2=0x7f4cc40d3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2707795443 >> v2:172.21.15.102:3300/0 conn(0x7f4cc40d1c70 0x7f4cc40d3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc1ffb640 1 -- 172.21.15.5:0/2707795443 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945297807 0 0) 0x7f4cc40d17f0 con 0x7f4cc40cf3c0 2023-11-24T07:56:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc27fc640 1 -- 172.21.15.5:0/2707795443 >> v1:172.21.15.5:6789/0 conn(0x7f4cc40cf3c0 legacy=0x7f4cc41608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.775+0000 7f4cc27fc640 1 -- 172.21.15.5:0/2707795443 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc40ce680 con 0x7f4cc40d1310 2023-11-24T07:56:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2707795443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc40cee80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408c150 tx=0x7f4cb801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22570eb679e8e9f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc1ffb640 1 -- 172.21.15.5:0/2707795443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80ab650 con 0x7f4cc40d1310 2023-11-24T07:56:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc1ffb640 1 -- 172.21.15.5:0/2707795443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb80ab7b0 con 0x7f4cc40d1310 2023-11-24T07:56:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc1ffb640 1 -- 172.21.15.5:0/2707795443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80abb40 con 0x7f4cc40d1310 2023-11-24T07:56:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- 172.21.15.5:0/2707795443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 msgr2=0x7f4cc40cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2707795443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc40cee80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408c150 tx=0x7f4cb801ce90 comp rx=0 tx=0).stop 2023-11-24T07:56:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- 172.21.15.5:0/2707795443 shutdown_connections 2023-11-24T07:56:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2707795443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc40cee80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2707795443 >> v2:172.21.15.102:3300/0 conn(0x7f4cc40d1c70 0x7f4cc40d3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- 172.21.15.5:0/2707795443 >> 172.21.15.5:0/2707795443 conn(0x7f4cc408afc0 msgr2=0x7f4cc40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- 172.21.15.5:0/2707795443 shutdown_connections 2023-11-24T07:56:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- 172.21.15.5:0/2707795443 wait complete. 2023-11-24T07:56:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 Processor -- start 2023-11-24T07:56:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.779+0000 7f4cc9380640 1 -- start start 2023-11-24T07:56:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 0x7f4cc40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc40caef0 0x7f4cc415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c7850 con 0x7f4cc40d1310 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c6f40 con 0x7f4cc40caef0 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40cd460 con 0x7f4cc40d1c70 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53598/0 (socket says 172.21.15.5:53598) 2023-11-24T07:56:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 -- 172.21.15.5:0/2317121688 learned_addr learned my addr 172.21.15.5:0/2317121688 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc37fe640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc40caef0 0x7f4cc415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 0x7f4cc40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 -- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 msgr2=0x7f4cc40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 0x7f4cc40cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 -- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc40caef0 msgr2=0x7f4cc415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc40caef0 0x7f4cc415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 -- 172.21.15.5:0/2317121688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb8009420 con 0x7f4cc40d1310 2023-11-24T07:56:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 0x7f4cc40cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc2ffd640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400d5f0 tx=0x7f4cb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40125f0 con 0x7f4cc40d1310 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb4012750 con 0x7f4cc40d1310 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4012ae0 con 0x7f4cc40d1310 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc4156ce0 con 0x7f4cc40d1310 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40c7190 con 0x7f4cc40d1310 2023-11-24T07:56:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.783+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc4074a00 con 0x7f4cc40d1310 2023-11-24T07:56:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.787+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cb4012c40 con 0x7f4cc40d1310 2023-11-24T07:56:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.787+0000 7f4cab7fe640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 0x7f4cb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.787+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4cb4083ff0 con 0x7f4cc40d1310 2023-11-24T07:56:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.787+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 0x7f4cb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.787+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 0x7f4cb0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80af000 tx=0x7f4cb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.791+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cb40b5280 con 0x7f4cc40d1310 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4cc408b510 con 0x7f4cc40d1310 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cab7fe640 1 -- 172.21.15.5:0/2317121688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4cb40517d0 con 0x7f4cc40d1310 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:56:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-11-24T07:56:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-11-24T07:56:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:56:46.954 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-11-24T07:56:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 msgr2=0x7f4cb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 0x7f4cb0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80af000 tx=0x7f4cb8008040 comp rx=0 tx=0).stop 2023-11-24T07:56:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 msgr2=0x7f4cc41567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400d5f0 tx=0x7f4cb400dab0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 shutdown_connections 2023-11-24T07:56:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb0066470 0x7f4cb0068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc40caef0 0x7f4cc415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40d1c70 0x7f4cc40cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 --2- 172.21.15.5:0/2317121688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc40d1310 0x7f4cc41567a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:46.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 >> 172.21.15.5:0/2317121688 conn(0x7f4cc408afc0 msgr2=0x7f4cc40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:46.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 shutdown_connections 2023-11-24T07:56:46.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:46.951+0000 7f4cc9380640 1 -- 172.21.15.5:0/2317121688 wait complete. 2023-11-24T07:56:46.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T07:56:46.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T07:56:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 Processor -- start 2023-11-24T07:56:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 -- start start 2023-11-24T07:56:47.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f5c0b1820 0x7f9f5c0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0b0130 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c06acc0 con 0x7f9f5c15b4b0 2023-11-24T07:56:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f6358d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0afb00 con 0x7f9f5c0b1820 2023-11-24T07:56:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f60b28640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f5c0b05c0 0x7f9f5c0b1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34868/0 (socket says 172.21.15.5:34868) 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f60b28640 1 -- 172.21.15.5:0/3241973809 learned_addr learned my addr 172.21.15.5:0/3241973809 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f61b2a640 1 --2- 172.21.15.5:0/3241973809 >> v2:172.21.15.5:3300/0 conn(0x7f9f5c0b1820 0x7f9f5c0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f53fff640 1 -- 172.21.15.5:0/3241973809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930761748 0 0) 0x7f9f5c0b0130 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f61b2a640 1 -- 172.21.15.5:0/3241973809 >> v1:172.21.15.102:6789/0 conn(0x7f9f5c15b4b0 legacy=0x7f9f5c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f61b2a640 1 -- 172.21.15.5:0/3241973809 >> v1:172.21.15.5:6789/0 conn(0x7f9f5c0b05c0 legacy=0x7f9f5c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.119+0000 7f9f61b2a640 1 -- 172.21.15.5:0/3241973809 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c06af70 con 0x7f9f5c0b1820 2023-11-24T07:56:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f61b2a640 1 --2- 172.21.15.5:0/3241973809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b1820 0x7f9f5c0ad030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d90 tx=0x7f9f5401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4083c2ce12f83ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:47.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f53fff640 1 -- 172.21.15.5:0/3241973809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540a5920 con 0x7f9f5c0b1820 2023-11-24T07:56:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f53fff640 1 -- 172.21.15.5:0/3241973809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f540a5a80 con 0x7f9f5c0b1820 2023-11-24T07:56:47.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f53fff640 1 -- 172.21.15.5:0/3241973809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540a5e10 con 0x7f9f5c0b1820 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 -- 172.21.15.5:0/3241973809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b1820 msgr2=0x7f9f5c0ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 --2- 172.21.15.5:0/3241973809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b1820 0x7f9f5c0ad030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d90 tx=0x7f9f5401c860 comp rx=0 tx=0).stop 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 -- 172.21.15.5:0/3241973809 shutdown_connections 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 --2- 172.21.15.5:0/3241973809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b1820 0x7f9f5c0ad030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 -- 172.21.15.5:0/3241973809 >> 172.21.15.5:0/3241973809 conn(0x7f9f5c0b1d50 msgr2=0x7f9f5c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 -- 172.21.15.5:0/3241973809 shutdown_connections 2023-11-24T07:56:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.123+0000 7f9f6358d640 1 -- 172.21.15.5:0/3241973809 wait complete. 2023-11-24T07:56:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 Processor -- start 2023-11-24T07:56:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- start start 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 0x7f9f5c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 0x7f9f5c0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c15a8d0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c6430 con 0x7f9f5c15b4b0 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c7880 con 0x7f9f5c0b1820 2023-11-24T07:56:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53628/0 (socket says 172.21.15.5:53628) 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 -- 172.21.15.5:0/875355059 learned_addr learned my addr 172.21.15.5:0/875355059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f60b28640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 0x7f9f5c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61b2a640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 0x7f9f5c0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 -- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 msgr2=0x7f9f5c0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 0x7f9f5c0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 -- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 msgr2=0x7f9f5c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 0x7f9f5c0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 -- 172.21.15.5:0/875355059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009a70 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f60b28640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 0x7f9f5c0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61b2a640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 0x7f9f5c0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:47.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f61329640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c500 tx=0x7f9f5800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005220 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58005380 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58007270 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0c68c0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.127+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0c5de0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0b09a0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f580073d0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f51ffb640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f58083410 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f60b28640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.131+0000 7f9f60b28640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 0x7f9f40068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cfc80 tx=0x7f9f4c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.135+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f5c0b09a0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.291+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9f5c0b09a0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f51ffb640 1 -- 172.21.15.5:0/875355059 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9f5c0b09a0 con 0x7f9f5c0b05c0 2023-11-24T07:56:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-11-24T07:56:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 msgr2=0x7f9f40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 0x7f9f40068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cfc80 tx=0x7f9f4c007df0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 msgr2=0x7f9f5c0c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:47.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c500 tx=0x7f9f5800c9c0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 shutdown_connections 2023-11-24T07:56:47.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f5c15b4b0 0x7f9f5c0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f5c0b1820 0x7f9f5c0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 --2- 172.21.15.5:0/875355059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5c0b05c0 0x7f9f5c0c71f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:47.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 >> 172.21.15.5:0/875355059 conn(0x7f9f5c0b1d50 msgr2=0x7f9f5c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:47.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 shutdown_connections 2023-11-24T07:56:47.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:47.951+0000 7f9f6358d640 1 -- 172.21.15.5:0/875355059 wait complete. 2023-11-24T07:56:47.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T07:56:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 Processor -- start 2023-11-24T07:56:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 -- start start 2023-11-24T07:56:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e00144d50 0x7f0e000b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0015fcb0 con 0x7f0e0015f5f0 2023-11-24T07:56:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000b5790 con 0x7f0e000b5160 2023-11-24T07:56:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e087e7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e000b5a70 con 0x7f0e00144d50 2023-11-24T07:56:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e06d84640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e0015f5f0 0x7f0e000d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35832/0 (socket says 172.21.15.5:35832) 2023-11-24T07:56:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e06d84640 1 -- 172.21.15.5:0/3179045475 learned_addr learned my addr 172.21.15.5:0/3179045475 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> v2:172.21.15.102:3300/0 conn(0x7f0e00144d50 0x7f0e000b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703923487 0 0) 0x7f0e0015fcb0 con 0x7f0e0015f5f0 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dec003530 con 0x7f0e0015f5f0 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182358416 0 0) 0x7f0e000b5790 con 0x7f0e000b5160 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e0015fcb0 con 0x7f0e000b5160 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3610148659 0 0) 0x7f0dec003530 con 0x7f0e0015f5f0 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 >> v2:172.21.15.102:3300/0 conn(0x7f0e00144d50 msgr2=0x7f0e000b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 --2- 172.21.15.5:0/3179045475 >> v2:172.21.15.102:3300/0 conn(0x7f0e00144d50 0x7f0e000b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 >> v1:172.21.15.102:6789/0 conn(0x7f0e000b5160 legacy=0x7f0e0015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000d0150 con 0x7f0e0015f5f0 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f0df8001a00 con 0x7f0e0015f5f0 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> v2:172.21.15.102:3300/0 conn(0x7f0e00144d50 0x7f0e000b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 >> v1:172.21.15.5:6789/0 conn(0x7f0e0015f5f0 legacy=0x7f0e000d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 0x7f0dec003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0dec0047d0 0x7f0dec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec005190 0x7f0dec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000b5a70 con 0x7f0dec003b10 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec00c010 con 0x7f0dec005190 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.131+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec00c1d0 con 0x7f0dec0047d0 2023-11-24T07:56:48.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 0x7f0dec003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06d84640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec005190 0x7f0dec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e05d82640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0dec0047d0 0x7f0dec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 -- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0dec0047d0 msgr2=0x7f0dec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0dec0047d0 0x7f0dec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 -- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec005190 msgr2=0x7f0dec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec005190 0x7f0dec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06d84640 1 -- 172.21.15.5:0/3179045475 reap_dead start 2023-11-24T07:56:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 -- 172.21.15.5:0/3179045475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec003530 con 0x7f0dec003b10 2023-11-24T07:56:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e06583640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 0x7f0dec003f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009cb0 tx=0x7f0dfc01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2dff342ee71504 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a5720 con 0x7f0dec003b10 2023-11-24T07:56:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0a5880 con 0x7f0dec003b10 2023-11-24T07:56:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.135+0000 7f0e05581640 1 -- 172.21.15.5:0/3179045475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0a5c70 con 0x7f0dec003b10 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 msgr2=0x7f0dec003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 0x7f0dec003f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009cb0 tx=0x7f0dfc01cbf0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- 172.21.15.5:0/3179045475 shutdown_connections 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 --2- 172.21.15.5:0/3179045475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0dec003b10 0x7f0dec003f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- 172.21.15.5:0/3179045475 >> 172.21.15.5:0/3179045475 conn(0x7f0e000b2f10 msgr2=0x7f0e000b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- 172.21.15.5:0/3179045475 shutdown_connections 2023-11-24T07:56:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- 172.21.15.5:0/3179045475 wait complete. 2023-11-24T07:56:48.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 Processor -- start 2023-11-24T07:56:48.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- start start 2023-11-24T07:56:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec003b10 0x7f0e000ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e0013fb60 0x7f0e00143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000afe30 con 0x7f0e0013c6f0 2023-11-24T07:56:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0013d0b0 con 0x7f0dec003b10 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e087e7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000b0250 con 0x7f0e0013fb60 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56646/0 (socket says 172.21.15.5:56646) 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 -- 172.21.15.5:0/1785767813 learned_addr learned my addr 172.21.15.5:0/1785767813 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06583640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec003b10 0x7f0e000ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e05d82640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e0013fb60 0x7f0e00143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 -- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e0013fb60 msgr2=0x7f0e00143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e0013fb60 0x7f0e00143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 -- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec003b10 msgr2=0x7f0e000ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec003b10 0x7f0e000ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.139+0000 7f0e06d84640 1 -- 172.21.15.5:0/1785767813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000af1b0 con 0x7f0e0013c6f0 2023-11-24T07:56:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0e06d84640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0df8002240 tx=0x7f0df8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800aad0 con 0x7f0e0013c6f0 2023-11-24T07:56:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df800ac50 con 0x7f0e0013c6f0 2023-11-24T07:56:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000af490 con 0x7f0e0013c6f0 2023-11-24T07:56:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df80133f0 con 0x7f0e0013c6f0 2023-11-24T07:56:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e000afa50 con 0x7f0e0013c6f0 2023-11-24T07:56:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e000aff70 con 0x7f0e0013c6f0 2023-11-24T07:56:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.143+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0df8013550 con 0x7f0e0013c6f0 2023-11-24T07:56:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.147+0000 7f0df6ffd640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.147+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0df8084b10 con 0x7f0e0013c6f0 2023-11-24T07:56:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.147+0000 7f0e06583640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.147+0000 7f0e06583640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 0x7f0de4068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0af000 tx=0x7f0dfc0a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.147+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0df8052270 con 0x7f0e0013c6f0 2023-11-24T07:56:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.311+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0e000aff70 con 0x7f0e0013c6f0 2023-11-24T07:56:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.959+0000 7f0df6ffd640 1 -- 172.21.15.5:0/1785767813 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0e000aff70 con 0x7f0e0013c6f0 2023-11-24T07:56:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-11-24T07:56:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 msgr2=0x7f0de4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 0x7f0de4068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0af000 tx=0x7f0dfc0a7040 comp rx=0 tx=0).stop 2023-11-24T07:56:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 msgr2=0x7f0e0013cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0df8002240 tx=0x7f0df8007b00 comp rx=0 tx=0).stop 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 shutdown_connections 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e0013c6f0 0x7f0e0013cb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e0013fb60 0x7f0e00143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 --2- 172.21.15.5:0/1785767813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec003b10 0x7f0e000ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 >> 172.21.15.5:0/1785767813 conn(0x7f0e000b2f10 msgr2=0x7f0e0015ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 shutdown_connections 2023-11-24T07:56:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:48.963+0000 7f0e087e7640 1 -- 172.21.15.5:0/1785767813 wait complete. 2023-11-24T07:56:49.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T07:56:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 Processor -- start 2023-11-24T07:56:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 -- start start 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1040cc460 0x7fc1040abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040b2710 con 0x7fc10415a710 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040b29f0 con 0x7fc1040cdfb0 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc1091c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1040cca80 con 0x7fc1040cc460 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc10259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc10415a710 0x7fc1040cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35844/0 (socket says 172.21.15.5:35844) 2023-11-24T07:56:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc10259c640 1 -- 172.21.15.5:0/1599706455 learned_addr learned my addr 172.21.15.5:0/1599706455 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc10359e640 1 --2- 172.21.15.5:0/1599706455 >> v2:172.21.15.102:3300/0 conn(0x7fc1040cc460 0x7fc1040abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757298966 0 0) 0x7fc1040b2710 con 0x7fc10415a710 2023-11-24T07:56:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ec003530 con 0x7fc10415a710 2023-11-24T07:56:49.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518790623 0 0) 0x7fc0ec003530 con 0x7fc10415a710 2023-11-24T07:56:49.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 >> v2:172.21.15.102:3300/0 conn(0x7fc1040cc460 msgr2=0x7fc1040abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 --2- 172.21.15.5:0/1599706455 >> v2:172.21.15.102:3300/0 conn(0x7fc1040cc460 0x7fc1040abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 >> v1:172.21.15.102:6789/0 conn(0x7fc1040cdfb0 legacy=0x7fc1040ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040b2cd0 con 0x7fc10415a710 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7fc0f8001680 con 0x7fc10415a710 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 >> v1:172.21.15.5:6789/0 conn(0x7fc10415a710 legacy=0x7fc1040cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec003980 0x7fc0ec003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc0ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec005050 0x7fc0ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040cca80 con 0x7fc0ec004380 2023-11-24T07:56:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec00bfb0 con 0x7fc0ec005050 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec00c170 con 0x7fc0ec003980 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc10259c640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc0ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.155+0000 7fc102d9d640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec003980 0x7fc0ec003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10359e640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec005050 0x7fc0ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 -- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec003980 msgr2=0x7fc0ec003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec003980 0x7fc0ec003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 -- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec005050 msgr2=0x7fc0ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec005050 0x7fc0ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 -- 172.21.15.5:0/1599706455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec003530 con 0x7fc0ec004380 2023-11-24T07:56:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10359e640 1 -- 172.21.15.5:0/1599706455 reap_dead start 2023-11-24T07:56:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc10259c640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc0ec004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc10415ab10 tx=0x7fc0f801ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435944d7260936d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80a7c90 con 0x7fc0ec004380 2023-11-24T07:56:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a7e10 con 0x7fc0ec004380 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc101d9b640 1 -- 172.21.15.5:0/1599706455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8005b20 con 0x7fc0ec004380 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc1091c4640 1 -- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 msgr2=0x7fc0ec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc1091c4640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc0ec004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc10415ab10 tx=0x7fc0f801ed90 comp rx=0 tx=0).stop 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc1091c4640 1 -- 172.21.15.5:0/1599706455 shutdown_connections 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.159+0000 7fc1091c4640 1 --2- 172.21.15.5:0/1599706455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc0ec004850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- 172.21.15.5:0/1599706455 >> 172.21.15.5:0/1599706455 conn(0x7fc1040b0cb0 msgr2=0x7fc1040b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- 172.21.15.5:0/1599706455 shutdown_connections 2023-11-24T07:56:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- 172.21.15.5:0/1599706455 wait complete. 2023-11-24T07:56:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 Processor -- start 2023-11-24T07:56:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- start start 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc104147580 0x7fc104157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc104144950 0x7fc1041469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10409b370 con 0x7fc0ec004380 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10409b650 con 0x7fc104144950 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc1091c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10409b930 con 0x7fc104147580 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56672/0 (socket says 172.21.15.5:56672) 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 -- 172.21.15.5:0/2224988224 learned_addr learned my addr 172.21.15.5:0/2224988224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc10359e640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc104144950 0x7fc1041469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc10259c640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc104147580 0x7fc104157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 -- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc104147580 msgr2=0x7fc104157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc104147580 0x7fc104157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 -- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc104144950 msgr2=0x7fc1041469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc104144950 0x7fc1041469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.163+0000 7fc102d9d640 1 -- 172.21.15.5:0/2224988224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10409bc10 con 0x7fc0ec004380 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc102d9d640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40114e0 tx=0x7fc0f40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4015820 con 0x7fc0ec004380 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4015980 con 0x7fc0ec004380 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4015d30 con 0x7fc0ec004380 2023-11-24T07:56:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10409bef0 con 0x7fc0ec004380 2023-11-24T07:56:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc104157bd0 con 0x7fc0ec004380 2023-11-24T07:56:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1040671f0 con 0x7fc0ec004380 2023-11-24T07:56:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0f4013390 con 0x7fc0ec004380 2023-11-24T07:56:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.167+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc0f4086bc0 con 0x7fc0ec004380 2023-11-24T07:56:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.171+0000 7fc10259c640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.171+0000 7fc10259c640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 0x7fc0f0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.175+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0f40540b0 con 0x7fc0ec004380 2023-11-24T07:56:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.363+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc10406b460 con 0x7fc0ec004380 2023-11-24T07:56:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.975+0000 7fc0eb7fe640 1 -- 172.21.15.5:0/2224988224 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc0f40576d0 con 0x7fc0ec004380 2023-11-24T07:56:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T07:56:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 msgr2=0x7fc0f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 0x7fc0f0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80b2040 comp rx=0 tx=0).stop 2023-11-24T07:56:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 msgr2=0x7fc10415d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40114e0 tx=0x7fc0f40119a0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 shutdown_connections 2023-11-24T07:56:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc104144950 0x7fc1041469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc104147580 0x7fc104157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.987+0000 7fc1091c4640 1 --2- 172.21.15.5:0/2224988224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0ec004380 0x7fc10415d410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.991+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 >> 172.21.15.5:0/2224988224 conn(0x7fc1040b0cb0 msgr2=0x7fc1040cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.991+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 shutdown_connections 2023-11-24T07:56:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:49.991+0000 7fc1091c4640 1 -- 172.21.15.5:0/2224988224 wait complete. 2023-11-24T07:56:50.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.175+0000 7f6a64491640 1 Processor -- start 2023-11-24T07:56:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.175+0000 7f6a64491640 1 -- start start 2023-11-24T07:56:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a64491640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a64491640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 0x7f6a5c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a64491640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0cefd0 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a64491640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0d2340 con 0x7f6a5c0cead0 2023-11-24T07:56:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a64491640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0cf2b0 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a62a2e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a5c0d1eb0 0x7f6a5c0cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35852/0 (socket says 172.21.15.5:35852) 2023-11-24T07:56:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a62a2e640 1 -- 172.21.15.5:0/3121056538 learned_addr learned my addr 172.21.15.5:0/3121056538 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6222d640 1 --2- 172.21.15.5:0/3121056538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a61a2c640 1 --2- 172.21.15.5:0/3121056538 >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 0x7f6a5c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6122b640 1 -- 172.21.15.5:0/3121056538 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424445557 0 0) 0x7f6a5c0cefd0 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6122b640 1 -- 172.21.15.5:0/3121056538 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003530 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6222d640 1 -- 172.21.15.5:0/3121056538 >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 msgr2=0x7f6a5c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6222d640 1 --2- 172.21.15.5:0/3121056538 >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 0x7f6a5c0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6222d640 1 -- 172.21.15.5:0/3121056538 >> v1:172.21.15.5:6789/0 conn(0x7f6a5c0d1eb0 legacy=0x7f6a5c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a6222d640 1 -- 172.21.15.5:0/3121056538 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c06b3f0 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.179+0000 7f6a61a2c640 1 --2- 172.21.15.5:0/3121056538 >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 0x7f6a5c0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:50.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a6222d640 1 --2- 172.21.15.5:0/3121056538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c0d10d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a580097c0 tx=0x7f6a5801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d74efeaba94b5ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a6122b640 1 -- 172.21.15.5:0/3121056538 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580ab600 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a6122b640 1 -- 172.21.15.5:0/3121056538 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a580a7050 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a6122b640 1 -- 172.21.15.5:0/3121056538 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580ab960 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- 172.21.15.5:0/3121056538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 msgr2=0x7f6a5c0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 --2- 172.21.15.5:0/3121056538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c0d10d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a580097c0 tx=0x7f6a5801c330 comp rx=0 tx=0).stop 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- 172.21.15.5:0/3121056538 shutdown_connections 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 --2- 172.21.15.5:0/3121056538 >> v2:172.21.15.102:3300/0 conn(0x7f6a5c0cead0 0x7f6a5c0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 --2- 172.21.15.5:0/3121056538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c0d10d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- 172.21.15.5:0/3121056538 >> 172.21.15.5:0/3121056538 conn(0x7f6a5c0d33b0 msgr2=0x7f6a5c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- 172.21.15.5:0/3121056538 shutdown_connections 2023-11-24T07:56:50.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- 172.21.15.5:0/3121056538 wait complete. 2023-11-24T07:56:50.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 Processor -- start 2023-11-24T07:56:50.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.183+0000 7f6a64491640 1 -- start start 2023-11-24T07:56:50.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a5c0cead0 0x7f6a5c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c155240 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1549a0 con 0x7f6a5c0cead0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c154c80 con 0x7f6a5c15d7b0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56682/0 (socket says 172.21.15.5:56682) 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 -- 172.21.15.5:0/3544046237 learned_addr learned my addr 172.21.15.5:0/3544046237 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a6222d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a5c0cead0 0x7f6a5c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a62a2e640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 -- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 msgr2=0x7f6a5c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 -- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a5c0cead0 msgr2=0x7f6a5c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a5c0cead0 0x7f6a5c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 -- 172.21.15.5:0/3544046237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009420 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a61a2c640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e980 tx=0x7f6a4c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00ca00 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00cb60 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a58009420 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c013470 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0ca520 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.187+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c04e850 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.191+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a4c0135d0 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.191+0000 7f6a52ffd640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 0x7f6a40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.191+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a4c084060 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.191+0000 7f6a6222d640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 0x7f6a40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.191+0000 7f6a6222d640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 0x7f6a40068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ad000 tx=0x7f6a580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.195+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a4c051580 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.355+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5c0b08a0 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a52ffd640 1 -- 172.21.15.5:0/3544046237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f6a4c054ba0 con 0x7f6a5c0d1eb0 2023-11-24T07:56:50.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:50.361 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:49.369307+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 msgr2=0x7f6a40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 0x7f6a40068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ad000 tx=0x7f6a580a6000 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 msgr2=0x7f6a5c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e980 tx=0x7f6a4c00ee40 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 shutdown_connections 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6a40066470 0x7f6a40068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a5c15d7b0 0x7f6a5c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c0d1eb0 0x7f6a5c153f50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 --2- 172.21.15.5:0/3544046237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a5c0cead0 0x7f6a5c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 >> 172.21.15.5:0/3544046237 conn(0x7f6a5c0d33b0 msgr2=0x7f6a5c0d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 shutdown_connections 2023-11-24T07:56:50.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.359+0000 7f6a64491640 1 -- 172.21.15.5:0/3544046237 wait complete. 2023-11-24T07:56:50.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 Processor -- start 2023-11-24T07:56:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 -- start start 2023-11-24T07:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd901620d0 0x7efd9006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900ce6c0 con 0x7efd900b25b0 2023-11-24T07:56:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd900cddd0 con 0x7efd90161bd0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd9669c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9006d210 con 0x7efd901620d0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd900b25b0 0x7efd901614c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35862/0 (socket says 172.21.15.5:35862) 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8ffff640 1 -- 172.21.15.5:0/418141230 learned_addr learned my addr 172.21.15.5:0/418141230 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8f7fe640 1 --2- 172.21.15.5:0/418141230 >> v2:172.21.15.102:3300/0 conn(0x7efd901620d0 0x7efd9006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961966108 0 0) 0x7efd900ce6c0 con 0x7efd900b25b0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd78003530 con 0x7efd900b25b0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947736280 0 0) 0x7efd900cddd0 con 0x7efd90161bd0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd900ce6c0 con 0x7efd90161bd0 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8f7fe640 1 -- 172.21.15.5:0/418141230 >> v1:172.21.15.102:6789/0 conn(0x7efd90161bd0 legacy=0x7efd9006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8f7fe640 1 -- 172.21.15.5:0/418141230 >> v1:172.21.15.5:6789/0 conn(0x7efd900b25b0 legacy=0x7efd901614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.523+0000 7efd8f7fe640 1 -- 172.21.15.5:0/418141230 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9006cf30 con 0x7efd901620d0 2023-11-24T07:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd8f7fe640 1 --2- 172.21.15.5:0/418141230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd901620d0 0x7efd9006b5d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd840097a0 tx=0x7efd8401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=861c4002b8ee1d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840a7070 con 0x7efd901620d0 2023-11-24T07:56:50.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd840ab430 con 0x7efd901620d0 2023-11-24T07:56:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd8effd640 1 -- 172.21.15.5:0/418141230 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840ab7c0 con 0x7efd901620d0 2023-11-24T07:56:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 -- 172.21.15.5:0/418141230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd901620d0 msgr2=0x7efd9006b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 --2- 172.21.15.5:0/418141230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd901620d0 0x7efd9006b5d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd840097a0 tx=0x7efd8401c430 comp rx=0 tx=0).stop 2023-11-24T07:56:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 -- 172.21.15.5:0/418141230 shutdown_connections 2023-11-24T07:56:50.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 --2- 172.21.15.5:0/418141230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd901620d0 0x7efd9006b5d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 -- 172.21.15.5:0/418141230 >> 172.21.15.5:0/418141230 conn(0x7efd9009c710 msgr2=0x7efd900d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 -- 172.21.15.5:0/418141230 shutdown_connections 2023-11-24T07:56:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.527+0000 7efd9669c640 1 -- 172.21.15.5:0/418141230 wait complete. 2023-11-24T07:56:50.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 Processor -- start 2023-11-24T07:56:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- start start 2023-11-24T07:56:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd900b25b0 0x7efd901501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 0x7efd900c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900c9460 con 0x7efd901620d0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b84f0 con 0x7efd90161bd0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd90150860 con 0x7efd900b25b0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56692/0 (socket says 172.21.15.5:56692) 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 -- 172.21.15.5:0/4282744484 learned_addr learned my addr 172.21.15.5:0/4282744484 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8f7fe640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 0x7efd900c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8ffff640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd900b25b0 0x7efd901501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 -- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd900b25b0 msgr2=0x7efd901501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd900b25b0 0x7efd901501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 -- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 msgr2=0x7efd900c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 0x7efd900c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 -- 172.21.15.5:0/4282744484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840093b0 con 0x7efd901620d0 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8f7fe640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 0x7efd900c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd94c39640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c680 tx=0x7efd8800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88003b80 con 0x7efd901620d0 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88003ce0 con 0x7efd901620d0 2023-11-24T07:56:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9006cd00 con 0x7efd901620d0 2023-11-24T07:56:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88005310 con 0x7efd901620d0 2023-11-24T07:56:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.531+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd90150e20 con 0x7efd901620d0 2023-11-24T07:56:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9004e850 con 0x7efd901620d0 2023-11-24T07:56:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd88005470 con 0x7efd901620d0 2023-11-24T07:56:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd8cff9640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 0x7efd7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd88083ac0 con 0x7efd901620d0 2023-11-24T07:56:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd8ffff640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 0x7efd7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.535+0000 7efd8ffff640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 0x7efd7c068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd80000f70 tx=0x7efd80007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.539+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd88050fe0 con 0x7efd901620d0 2023-11-24T07:56:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.695+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd900b91c0 con 0x7efd901620d0 2023-11-24T07:56:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd8cff9640 1 -- 172.21.15.5:0/4282744484 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7efd88054600 con 0x7efd901620d0 2023-11-24T07:56:50.701 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:50.701 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:49.369307+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 msgr2=0x7efd7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 0x7efd7c068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd80000f70 tx=0x7efd80007d40 comp rx=0 tx=0).stop 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 msgr2=0x7efd900c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c680 tx=0x7efd8800cb40 comp rx=0 tx=0).stop 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 shutdown_connections 2023-11-24T07:56:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7efd7c0664a0 0x7efd7c068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901620d0 0x7efd900c6eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd90161bd0 0x7efd900c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 --2- 172.21.15.5:0/4282744484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd900b25b0 0x7efd901501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 >> 172.21.15.5:0/4282744484 conn(0x7efd9009c710 msgr2=0x7efd9006b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 shutdown_connections 2023-11-24T07:56:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.699+0000 7efd9669c640 1 -- 172.21.15.5:0/4282744484 wait complete. 2023-11-24T07:56:50.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T07:56:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 Processor -- start 2023-11-24T07:56:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 -- start start 2023-11-24T07:56:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc364146820 0x7fc364070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc364147190 con 0x7fc3640b4210 2023-11-24T07:56:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36406d030 con 0x7fc36415eb50 2023-11-24T07:56:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc368a17640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc364161fa0 con 0x7fc364146820 2023-11-24T07:56:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc36259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc364146820 0x7fc364070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc35bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3640b4210 0x7fc364161180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35868/0 (socket says 172.21.15.5:35868) 2023-11-24T07:56:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc35bfff640 1 -- 172.21.15.5:0/471999477 learned_addr learned my addr 172.21.15.5:0/471999477 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc36259c640 1 -- 172.21.15.5:0/471999477 >> v1:172.21.15.102:6789/0 conn(0x7fc36415eb50 legacy=0x7fc364161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc36259c640 1 -- 172.21.15.5:0/471999477 >> v1:172.21.15.5:6789/0 conn(0x7fc3640b4210 legacy=0x7fc364161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc36259c640 1 -- 172.21.15.5:0/471999477 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364146c00 con 0x7fc364146820 2023-11-24T07:56:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.867+0000 7fc361d9b640 1 -- 172.21.15.5:0/471999477 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917554805 0 0) 0x7fc364147190 con 0x7fc3640b4210 2023-11-24T07:56:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc36259c640 1 --2- 172.21.15.5:0/471999477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc364146820 0x7fc364070a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc364146df0 tx=0x7fc35401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29d87f43e1e2e95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc361d9b640 1 -- 172.21.15.5:0/471999477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540ab650 con 0x7fc364146820 2023-11-24T07:56:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc361d9b640 1 -- 172.21.15.5:0/471999477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3540ab7b0 con 0x7fc364146820 2023-11-24T07:56:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc361d9b640 1 -- 172.21.15.5:0/471999477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540abb40 con 0x7fc364146820 2023-11-24T07:56:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 -- 172.21.15.5:0/471999477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc364146820 msgr2=0x7fc364070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 --2- 172.21.15.5:0/471999477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc364146820 0x7fc364070a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc364146df0 tx=0x7fc35401c450 comp rx=0 tx=0).stop 2023-11-24T07:56:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 -- 172.21.15.5:0/471999477 shutdown_connections 2023-11-24T07:56:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 --2- 172.21.15.5:0/471999477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc364146820 0x7fc364070a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 -- 172.21.15.5:0/471999477 >> 172.21.15.5:0/471999477 conn(0x7fc3640b2f10 msgr2=0x7fc3640b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 -- 172.21.15.5:0/471999477 shutdown_connections 2023-11-24T07:56:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.871+0000 7fc368a17640 1 -- 172.21.15.5:0/471999477 wait complete. 2023-11-24T07:56:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 Processor -- start 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- start start 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3640b4210 0x7fc36413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc364146820 0x7fc36415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364140400 con 0x7fc36415eb50 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36413f860 con 0x7fc364146820 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36413fad0 con 0x7fc3640b4210 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56700/0 (socket says 172.21.15.5:56700) 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 -- 172.21.15.5:0/774898526 learned_addr learned my addr 172.21.15.5:0/774898526 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc35bfff640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc364146820 0x7fc36415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc36259c640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3640b4210 0x7fc36413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 -- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3640b4210 msgr2=0x7fc36413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3640b4210 0x7fc36413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 -- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc364146820 msgr2=0x7fc36415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc364146820 0x7fc36415c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 -- 172.21.15.5:0/774898526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009420 con 0x7fc36415eb50 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc362d9d640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00c7a0 tx=0x7fc35c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c003b80 con 0x7fc36415eb50 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c003ce0 con 0x7fc36415eb50 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00aa90 con 0x7fc36415eb50 2023-11-24T07:56:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36413fdb0 con 0x7fc36415eb50 2023-11-24T07:56:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36413d8a0 con 0x7fc36415eb50 2023-11-24T07:56:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.875+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3641405b0 con 0x7fc36415eb50 2023-11-24T07:56:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.879+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc35c00abf0 con 0x7fc36415eb50 2023-11-24T07:56:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.879+0000 7fc35affd640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 0x7fc344068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.879+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc35c083cd0 con 0x7fc36415eb50 2023-11-24T07:56:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.879+0000 7fc36259c640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 0x7fc344068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.879+0000 7fc36259c640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 0x7fc344068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3540af000 tx=0x7fc3540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:50.883+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3641405b0 con 0x7fc36415eb50 2023-11-24T07:56:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.079+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3641405b0 con 0x7fc36415eb50 2023-11-24T07:56:51.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc35affd640 1 -- 172.21.15.5:0/774898526 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3641405b0 con 0x7fc36415eb50 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 msgr2=0x7fc344068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 0x7fc344068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3540af000 tx=0x7fc3540a7000 comp rx=0 tx=0).stop 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 msgr2=0x7fc36413bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00c7a0 tx=0x7fc35c00cc60 comp rx=0 tx=0).stop 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 shutdown_connections 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc344066470 0x7fc344068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc36415eb50 0x7fc36413bb60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc364146820 0x7fc36415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 --2- 172.21.15.5:0/774898526 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3640b4210 0x7fc36413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 >> 172.21.15.5:0/774898526 conn(0x7fc3640b2f10 msgr2=0x7fc3640b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 shutdown_connections 2023-11-24T07:56:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:51.991+0000 7fc368a17640 1 -- 172.21.15.5:0/774898526 wait complete. 2023-11-24T07:56:52.018 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T07:56:52.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T07:56:52.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.163+0000 7f4500217640 1 Processor -- start 2023-11-24T07:56:52.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.163+0000 7f4500217640 1 -- start start 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f4500217640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44f80cb9b0 0x7f44f806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f4500217640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80ce5d0 0x7f44f815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f4500217640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f8159630 con 0x7f44f80cbd90 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f4500217640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f815bba0 con 0x7f44f80cb9b0 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f4500217640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80cdd50 con 0x7f44f80ce5d0 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44f80cb9b0 0x7f44f806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fd7b2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f44f80cbd90 0x7f44f815f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35876/0 (socket says 172.21.15.5:35876) 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fd7b2640 1 -- 172.21.15.5:0/1447410828 learned_addr learned my addr 172.21.15.5:0/1447410828 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fe7b4640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80ce5d0 0x7f44f815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 -- 172.21.15.5:0/1447410828 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80ce5d0 msgr2=0x7f44f815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80ce5d0 0x7f44f815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 -- 172.21.15.5:0/1447410828 >> v1:172.21.15.5:6789/0 conn(0x7f44f80cbd90 legacy=0x7f44f815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 -- 172.21.15.5:0/1447410828 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80cd1d0 con 0x7f44f80cb9b0 2023-11-24T07:56:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.167+0000 7f44fdfb3640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cb9b0 0x7f44f806e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097c0 tx=0x7f44f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21705c052991ce0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f44fcfb1640 1 -- 172.21.15.5:0/1447410828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40a7070 con 0x7f44f80cb9b0 2023-11-24T07:56:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f44fcfb1640 1 -- 172.21.15.5:0/1447410828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f40ab430 con 0x7f44f80cb9b0 2023-11-24T07:56:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f44fcfb1640 1 -- 172.21.15.5:0/1447410828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40ab7c0 con 0x7f44f80cb9b0 2023-11-24T07:56:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- 172.21.15.5:0/1447410828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cb9b0 msgr2=0x7f44f806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cb9b0 0x7f44f806e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097c0 tx=0x7f44f401c450 comp rx=0 tx=0).stop 2023-11-24T07:56:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- 172.21.15.5:0/1447410828 shutdown_connections 2023-11-24T07:56:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80ce5d0 0x7f44f815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- 172.21.15.5:0/1447410828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cb9b0 0x7f44f806e3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- 172.21.15.5:0/1447410828 >> 172.21.15.5:0/1447410828 conn(0x7f44f80b0cb0 msgr2=0x7f44f80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- 172.21.15.5:0/1447410828 shutdown_connections 2023-11-24T07:56:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- 172.21.15.5:0/1447410828 wait complete. 2023-11-24T07:56:52.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 Processor -- start 2023-11-24T07:56:52.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- start start 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80cb9b0 0x7f44f80ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 0x7f44f80ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80b3a70 con 0x7f44f80cbd90 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80b2b70 con 0x7f44f80ce5d0 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f4500217640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80b2df0 con 0x7f44f80cb9b0 2023-11-24T07:56:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.171+0000 7f44fd7b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56718/0 (socket says 172.21.15.5:56718) 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 -- 172.21.15.5:0/1563070204 learned_addr learned my addr 172.21.15.5:0/1563070204 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fdfb3640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80cb9b0 0x7f44f80ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fe7b4640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 0x7f44f80ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 -- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80cb9b0 msgr2=0x7f44f80ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80cb9b0 0x7f44f80ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 -- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 msgr2=0x7f44f80ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 0x7f44f80ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 -- 172.21.15.5:0/1563070204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009420 con 0x7f44f80cbd90 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fe7b4640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 0x7f44f80ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44fd7b2640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c530 tx=0x7f44e800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8005cf0 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e8005e50 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8007270 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f80b30d0 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f80b3690 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f80671f0 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44e80073d0 con 0x7f44f80cbd90 2023-11-24T07:56:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 0x7f44dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.175+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44e80831f0 con 0x7f44f80cbd90 2023-11-24T07:56:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.179+0000 7f44fdfb3640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 0x7f44dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.179+0000 7f44fdfb3640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 0x7f44dc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f40af000 tx=0x7f44f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:52.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.179+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44e80507b0 con 0x7f44f80cbd90 2023-11-24T07:56:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.371+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f44f80b3bb0 con 0x7f44f80cbd90 2023-11-24T07:56:53.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f44ee7fc640 1 -- 172.21.15.5:0/1563070204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44f80b3bb0 con 0x7f44f80cbd90 2023-11-24T07:56:53.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 msgr2=0x7f44dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 0x7f44dc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f40af000 tx=0x7f44f4008040 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 msgr2=0x7f44f80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c530 tx=0x7f44e800c9f0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 shutdown_connections 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44dc066470 0x7f44dc068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f80ce5d0 0x7f44f80ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44f80cbd90 0x7f44f80b2630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 --2- 172.21.15.5:0/1563070204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44f80cb9b0 0x7f44f80ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:52.999+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 >> 172.21.15.5:0/1563070204 conn(0x7f44f80b0cb0 msgr2=0x7f44f815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.003+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 shutdown_connections 2023-11-24T07:56:53.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.003+0000 7f4500217640 1 -- 172.21.15.5:0/1563070204 wait complete. 2023-11-24T07:56:53.027 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T07:56:53.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:56:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 Processor -- start 2023-11-24T07:56:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 -- start start 2023-11-24T07:56:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff354160d00 0x7ff3540d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3540ce1f0 con 0x7ff3540d3e40 2023-11-24T07:56:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff354161d50 con 0x7ff354160d00 2023-11-24T07:56:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35c3c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540cea70 con 0x7ff3541613a0 2023-11-24T07:56:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a95e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35995c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff3540d3e40 0x7ff3540cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53224/0 (socket says 172.21.15.5:53224) 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35995c640 1 -- 172.21.15.5:0/590858983 learned_addr learned my addr 172.21.15.5:0/590858983 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a15d640 1 --2- 172.21.15.5:0/590858983 >> v2:172.21.15.102:3300/0 conn(0x7ff354160d00 0x7ff3540d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a95e640 1 -- 172.21.15.5:0/590858983 >> v2:172.21.15.102:3300/0 conn(0x7ff354160d00 msgr2=0x7ff3540d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a95e640 1 --2- 172.21.15.5:0/590858983 >> v2:172.21.15.102:3300/0 conn(0x7ff354160d00 0x7ff3540d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35915b640 1 -- 172.21.15.5:0/590858983 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409704825 0 0) 0x7ff3540ce1f0 con 0x7ff3540d3e40 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a95e640 1 -- 172.21.15.5:0/590858983 >> v1:172.21.15.102:6789/0 conn(0x7ff3540d3e40 legacy=0x7ff3540cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.171+0000 7ff35a95e640 1 -- 172.21.15.5:0/590858983 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540cf610 con 0x7ff3541613a0 2023-11-24T07:56:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35a95e640 1 --2- 172.21.15.5:0/590858983 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354161810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009d90 tx=0x7ff34c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37bafa6f4a342f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35915b640 1 -- 172.21.15.5:0/590858983 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0af600 con 0x7ff3541613a0 2023-11-24T07:56:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35915b640 1 -- 172.21.15.5:0/590858983 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0ab050 con 0x7ff3541613a0 2023-11-24T07:56:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35915b640 1 -- 172.21.15.5:0/590858983 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0af980 con 0x7ff3541613a0 2023-11-24T07:56:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 -- 172.21.15.5:0/590858983 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 msgr2=0x7ff354161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/590858983 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354161810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009d90 tx=0x7ff34c01f130 comp rx=0 tx=0).stop 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 -- 172.21.15.5:0/590858983 shutdown_connections 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/590858983 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354161810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/590858983 >> v2:172.21.15.102:3300/0 conn(0x7ff354160d00 0x7ff3540d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 -- 172.21.15.5:0/590858983 >> 172.21.15.5:0/590858983 conn(0x7ff35408afc0 msgr2=0x7ff3540d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 -- 172.21.15.5:0/590858983 shutdown_connections 2023-11-24T07:56:53.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.175+0000 7ff35c3c1640 1 -- 172.21.15.5:0/590858983 wait complete. 2023-11-24T07:56:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 Processor -- start 2023-11-24T07:56:53.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- start start 2023-11-24T07:56:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff354160d00 0x7ff3540b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3541544c0 con 0x7ff3540d3e40 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540b6850 con 0x7ff354160d00 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540b6ac0 con 0x7ff3541613a0 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56734/0 (socket says 172.21.15.5:56734) 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 -- 172.21.15.5:0/3307783286 learned_addr learned my addr 172.21.15.5:0/3307783286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35995c640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff354160d00 0x7ff3540b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a95e640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 -- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 msgr2=0x7ff354159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 -- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff354160d00 msgr2=0x7ff3540b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff354160d00 0x7ff3540b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 -- 172.21.15.5:0/3307783286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009a70 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35a15d640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e960 tx=0x7ff35000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350009690 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000ca00 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000cd70 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3540b6da0 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.179+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3540b7360 con 0x7ff3540d3e40 2023-11-24T07:56:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35404e850 con 0x7ff3540d3e40 2023-11-24T07:56:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff350013470 con 0x7ff3540d3e40 2023-11-24T07:56:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff34affd640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 0x7ff338068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff350084270 con 0x7ff3540d3e40 2023-11-24T07:56:53.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff35995c640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 0x7ff338068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.183+0000 7ff35995c640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 0x7ff338068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3541f6c00 tx=0x7ff344009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.187+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3500515d0 con 0x7ff3540d3e40 2023-11-24T07:56:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff35408b4a0 con 0x7ff3540d3e40 2023-11-24T07:56:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff34affd640 1 -- 172.21.15.5:0/3307783286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff350054bf0 con 0x7ff3540d3e40 2023-11-24T07:56:53.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:53.385 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:56:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:56:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 msgr2=0x7ff338068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 0x7ff338068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3541f6c00 tx=0x7ff344009040 comp rx=0 tx=0).stop 2023-11-24T07:56:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 msgr2=0x7ff354153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e960 tx=0x7ff35000ee20 comp rx=0 tx=0).stop 2023-11-24T07:56:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 shutdown_connections 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff338066470 0x7ff338068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3541613a0 0x7ff354159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff354160d00 0x7ff3540b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 --2- 172.21.15.5:0/3307783286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3540d3e40 0x7ff354153f80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 >> 172.21.15.5:0/3307783286 conn(0x7ff35408afc0 msgr2=0x7ff3540cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 shutdown_connections 2023-11-24T07:56:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.383+0000 7ff35c3c1640 1 -- 172.21.15.5:0/3307783286 wait complete. 2023-11-24T07:56:53.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 Processor -- start 2023-11-24T07:56:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 -- start start 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11140cfe10 0x7f111415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11141407e0 con 0x7f11140d1b50 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140d1f30 con 0x7f11140707c0 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1118d35640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111413e6f0 con 0x7f11140cfe10 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1111d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11140cfe10 0x7f111415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f111259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11140d1b50 0x7f11140700b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35878/0 (socket says 172.21.15.5:35878) 2023-11-24T07:56:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f111259c640 1 -- 172.21.15.5:0/2121483372 learned_addr learned my addr 172.21.15.5:0/2121483372 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1111d9b640 1 -- 172.21.15.5:0/2121483372 >> v1:172.21.15.102:6789/0 conn(0x7f11140707c0 legacy=0x7f111415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1111d9b640 1 -- 172.21.15.5:0/2121483372 >> v1:172.21.15.5:6789/0 conn(0x7f11140d1b50 legacy=0x7f11140700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f1111d9b640 1 -- 172.21.15.5:0/2121483372 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111415c6f0 con 0x7f11140cfe10 2023-11-24T07:56:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.547+0000 7f111159a640 1 -- 172.21.15.5:0/2121483372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404592240 0 0) 0x7f11141407e0 con 0x7f11140d1b50 2023-11-24T07:56:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1111d9b640 1 --2- 172.21.15.5:0/2121483372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140cfe10 0x7f111415b9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11080097c0 tx=0x7f110801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e00469630657ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f111159a640 1 -- 172.21.15.5:0/2121483372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11080ab650 con 0x7f11140cfe10 2023-11-24T07:56:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f111159a640 1 -- 172.21.15.5:0/2121483372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11080ab7b0 con 0x7f11140cfe10 2023-11-24T07:56:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f111159a640 1 -- 172.21.15.5:0/2121483372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11080abb40 con 0x7f11140cfe10 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 -- 172.21.15.5:0/2121483372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140cfe10 msgr2=0x7f111415b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 --2- 172.21.15.5:0/2121483372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140cfe10 0x7f111415b9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11080097c0 tx=0x7f110801c450 comp rx=0 tx=0).stop 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 -- 172.21.15.5:0/2121483372 shutdown_connections 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 --2- 172.21.15.5:0/2121483372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140cfe10 0x7f111415b9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 -- 172.21.15.5:0/2121483372 >> 172.21.15.5:0/2121483372 conn(0x7f111406e950 msgr2=0x7f111406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 -- 172.21.15.5:0/2121483372 shutdown_connections 2023-11-24T07:56:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.551+0000 7f1118d35640 1 -- 172.21.15.5:0/2121483372 wait complete. 2023-11-24T07:56:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 Processor -- start 2023-11-24T07:56:53.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- start start 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11140707c0 0x7f1114154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11140cfe10 0x7f111413a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141545d0 con 0x7f11140d1b50 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114137a40 con 0x7f11140cfe10 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114136e30 con 0x7f11140707c0 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f111259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11140707c0 0x7f1114154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1111d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11140cfe10 0x7f111413a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56760/0 (socket says 172.21.15.5:56760) 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 -- 172.21.15.5:0/3126422030 learned_addr learned my addr 172.21.15.5:0/3126422030 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:53.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 -- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11140707c0 msgr2=0x7f1114154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11140707c0 0x7f1114154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 -- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11140cfe10 msgr2=0x7f111413a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11140cfe10 0x7f111413a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 -- 172.21.15.5:0/3126422030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009420 con 0x7f11140d1b50 2023-11-24T07:56:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1112d9d640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c7a0 tx=0x7f110c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c003b80 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c003ce0 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00aa30 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114137110 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.555+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141376d0 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114137bb0 con 0x7f11140d1b50 2023-11-24T07:56:53.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f110c00ab90 con 0x7f11140d1b50 2023-11-24T07:56:53.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f1102ffd640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 0x7f10f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f110c083bf0 con 0x7f11140d1b50 2023-11-24T07:56:53.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f111259c640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 0x7f10f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.559+0000 7f111259c640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 0x7f10f4068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1104007bc0 tx=0x7f1104007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.563+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f110c051080 con 0x7f11140d1b50 2023-11-24T07:56:53.616 INFO:tasks.ceph.mds.b.smithi102.stderr:2023-11-24T07:56:53.613+0000 7f9a2d94a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T07:56:53.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.719+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f111404e850 con 0x7f11140d1b50 2023-11-24T07:56:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.719+0000 7f1102ffd640 1 -- 172.21.15.5:0/3126422030 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f110c0546a0 con 0x7f11140d1b50 2023-11-24T07:56:53.723 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:53.723 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 msgr2=0x7f10f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 0x7f10f4068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1104007bc0 tx=0x7f1104007b10 comp rx=0 tx=0).stop 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 msgr2=0x7f1114137ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c7a0 tx=0x7f110c00cc60 comp rx=0 tx=0).stop 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 shutdown_connections 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f10f4066470 0x7f10f4068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d1b50 0x7f1114137ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11140cfe10 0x7f111413a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 --2- 172.21.15.5:0/3126422030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11140707c0 0x7f1114154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 >> 172.21.15.5:0/3126422030 conn(0x7f111406e950 msgr2=0x7f111415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 shutdown_connections 2023-11-24T07:56:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.723+0000 7f1118d35640 1 -- 172.21.15.5:0/3126422030 wait complete. 2023-11-24T07:56:53.744 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T07:56:53.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:56:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.883+0000 7f38eabec640 1 Processor -- start 2023-11-24T07:56:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.883+0000 7f38eabec640 1 -- start start 2023-11-24T07:56:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38e4144c80 0x7f38e40abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38e40ac460 0x7f38e40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e4070c20 0x7f38e415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e4145060 con 0x7f38e40ac460 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e4071fd0 con 0x7f38e4144c80 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38eabec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40ac8c0 con 0x7f38e4070c20 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38e40ac460 0x7f38e40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38e40ac460 0x7f38e40706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56768/0 (socket says 172.21.15.5:56768) 2023-11-24T07:56:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 -- 172.21.15.5:0/1540481046 learned_addr learned my addr 172.21.15.5:0/1540481046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e9189640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e4070c20 0x7f38e415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e8988640 1 --2- 172.21.15.5:0/1540481046 >> v2:172.21.15.102:3300/0 conn(0x7f38e4144c80 0x7f38e40abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 -- 172.21.15.5:0/1540481046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e4070c20 msgr2=0x7f38e415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e4070c20 0x7f38e415eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 -- 172.21.15.5:0/1540481046 >> v2:172.21.15.102:3300/0 conn(0x7f38e4144c80 msgr2=0x7f38e40abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 --2- 172.21.15.5:0/1540481046 >> v2:172.21.15.102:3300/0 conn(0x7f38e4144c80 0x7f38e40abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.887+0000 7f38e3fff640 1 -- 172.21.15.5:0/1540481046 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4071450 con 0x7f38e40ac460 2023-11-24T07:56:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38e3fff640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e40ac460 0x7f38e40706e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38e406eb80 tx=0x7f38d001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5462b6d7e81abf98 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38e37fe640 1 -- 172.21.15.5:0/1540481046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00ab600 con 0x7f38e40ac460 2023-11-24T07:56:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38e37fe640 1 -- 172.21.15.5:0/1540481046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d00a7050 con 0x7f38e40ac460 2023-11-24T07:56:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38e37fe640 1 -- 172.21.15.5:0/1540481046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00ab980 con 0x7f38e40ac460 2023-11-24T07:56:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- 172.21.15.5:0/1540481046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e40ac460 msgr2=0x7f38e40706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e40ac460 0x7f38e40706e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38e406eb80 tx=0x7f38d001c210 comp rx=0 tx=0).stop 2023-11-24T07:56:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- 172.21.15.5:0/1540481046 shutdown_connections 2023-11-24T07:56:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e4070c20 0x7f38e415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 --2- 172.21.15.5:0/1540481046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e40ac460 0x7f38e40706e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 --2- 172.21.15.5:0/1540481046 >> v2:172.21.15.102:3300/0 conn(0x7f38e4144c80 0x7f38e40abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- 172.21.15.5:0/1540481046 >> 172.21.15.5:0/1540481046 conn(0x7f38e40b0c40 msgr2=0x7f38e40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- 172.21.15.5:0/1540481046 shutdown_connections 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- 172.21.15.5:0/1540481046 wait complete. 2023-11-24T07:56:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 Processor -- start 2023-11-24T07:56:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.891+0000 7f38eabec640 1 -- start start 2023-11-24T07:56:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e40ac460 0x7f38e415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38e4144c80 0x7f38e40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40b4060 con 0x7f38e4070c20 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40afe70 con 0x7f38e4144c80 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e409c8c0 con 0x7f38e40ac460 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56772/0 (socket says 172.21.15.5:56772) 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 -- 172.21.15.5:0/2075812146 learned_addr learned my addr 172.21.15.5:0/2075812146 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e3fff640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e40ac460 0x7f38e415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e9189640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38e4144c80 0x7f38e40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 -- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e40ac460 msgr2=0x7f38e415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e40ac460 0x7f38e415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 -- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38e4144c80 msgr2=0x7f38e40b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38e4144c80 0x7f38e40b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 -- 172.21.15.5:0/2075812146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00094d0 con 0x7f38e4070c20 2023-11-24T07:56:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e8988640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38d800d5f0 tx=0x7f38d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80125f0 con 0x7f38e4070c20 2023-11-24T07:56:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8012750 con 0x7f38e4070c20 2023-11-24T07:56:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e409c5e0 con 0x7f38e4070c20 2023-11-24T07:56:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8012ae0 con 0x7f38e4070c20 2023-11-24T07:56:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e40b3c80 con 0x7f38e4070c20 2023-11-24T07:56:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.895+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e40b1ba0 con 0x7f38e4070c20 2023-11-24T07:56:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.899+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38d8012c40 con 0x7f38e4070c20 2023-11-24T07:56:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.899+0000 7f38e17fa640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 0x7f38c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.899+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38d8084cb0 con 0x7f38e4070c20 2023-11-24T07:56:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.899+0000 7f38e3fff640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 0x7f38c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.899+0000 7f38e3fff640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 0x7f38c8068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ad000 tx=0x7f38d00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:53.903+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38d8052250 con 0x7f38e4070c20 2023-11-24T07:56:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.063+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38e406c910 con 0x7f38c8066470 2023-11-24T07:56:54.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.075+0000 7f38e17fa640 1 -- 172.21.15.5:0/2075812146 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264594 (secure 0 0 0) 0x7f38d00bf450 con 0x7f38c8066470 2023-11-24T07:56:54.078 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:54.081 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:56:54.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 msgr2=0x7f38c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 0x7f38c8068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ad000 tx=0x7f38d00a6000 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 msgr2=0x7f38e40af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38d800d5f0 tx=0x7f38d800dab0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 shutdown_connections 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f38c8066470 0x7f38c8068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38e4144c80 0x7f38e40b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38e40ac460 0x7f38e415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 --2- 172.21.15.5:0/2075812146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38e4070c20 0x7f38e40af930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 >> 172.21.15.5:0/2075812146 conn(0x7f38e40b0c40 msgr2=0x7f38e40add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 shutdown_connections 2023-11-24T07:56:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.079+0000 7f38eabec640 1 -- 172.21.15.5:0/2075812146 wait complete. 2023-11-24T07:56:54.100 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-24T07:56:53.236381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235516,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739204,"statfs":{"total":773094113280,"available":772852944896,"internally_reserved":0,"allocated":2777088,"data_stored":1698360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.282638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988313+0000","last_change":"2023-11-24T07:56:50.004858+0000","last_active":"2023-11-24T07:56:50.988313+0000","last_peered":"2023-11-24T07:56:50.988313+0000","last_clean":"2023-11-24T07:56:50.988313+0000","last_became_active":"2023-11-24T07:56:49.993400+0000","last_became_peered":"2023-11-24T07:56:49.993400+0000","last_unstale":"2023-11-24T07:56:50.988313+0000","last_undegraded":"2023-11-24T07:56:50.988313+0000","last_fullsized":"2023-11-24T07:56:50.988313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:57.211418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994714+0000","last_change":"2023-11-24T07:56:49.991230+0000","last_active":"2023-11-24T07:56:49.994714+0000","last_peered":"2023-11-24T07:56:49.994714+0000","last_clean":"2023-11-24T07:56:49.994714+0000","last_became_active":"2023-11-24T07:56:49.990940+0000","last_became_peered":"2023-11-24T07:56:49.990940+0000","last_unstale":"2023-11-24T07:56:49.994714+0000","last_undegraded":"2023-11-24T07:56:49.994714+0000","last_fullsized":"2023-11-24T07:56:49.994714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994497+0000","last_change":"2023-11-24T07:56:49.989286+0000","last_active":"2023-11-24T07:56:49.994497+0000","last_peered":"2023-11-24T07:56:49.994497+0000","last_clean":"2023-11-24T07:56:49.994497+0000","last_became_active":"2023-11-24T07:56:49.988948+0000","last_became_peered":"2023-11-24T07:56:49.988948+0000","last_unstale":"2023-11-24T07:56:49.994497+0000","last_undegraded":"2023-11-24T07:56:49.994497+0000","last_fullsized":"2023-11-24T07:56:49.994497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.020253+0000","last_change":"2023-11-24T07:56:49.994907+0000","last_active":"2023-11-24T07:56:50.020253+0000","last_peered":"2023-11-24T07:56:50.020253+0000","last_clean":"2023-11-24T07:56:50.020253+0000","last_became_active":"2023-11-24T07:56:49.994332+0000","last_became_peered":"2023-11-24T07:56:49.994332+0000","last_unstale":"2023-11-24T07:56:50.020253+0000","last_undegraded":"2023-11-24T07:56:50.020253+0000","last_fullsized":"2023-11-24T07:56:50.020253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987792+0000","last_change":"2023-11-24T07:56:49.998831+0000","last_active":"2023-11-24T07:56:50.987792+0000","last_peered":"2023-11-24T07:56:50.987792+0000","last_clean":"2023-11-24T07:56:50.987792+0000","last_became_active":"2023-11-24T07:56:49.991235+0000","last_became_peered":"2023-11-24T07:56:49.991235+0000","last_unstale":"2023-11-24T07:56:50.987792+0000","last_undegraded":"2023-11-24T07:56:50.987792+0000","last_fullsized":"2023-11-24T07:56:50.987792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024115+0000","last_change":"2023-11-24T07:56:50.008660+0000","last_active":"2023-11-24T07:56:50.024115+0000","last_peered":"2023-11-24T07:56:50.024115+0000","last_clean":"2023-11-24T07:56:50.024115+0000","last_became_active":"2023-11-24T07:56:50.008297+0000","last_became_peered":"2023-11-24T07:56:50.008297+0000","last_unstale":"2023-11-24T07:56:50.024115+0000","last_undegraded":"2023-11-24T07:56:50.024115+0000","last_fullsized":"2023-11-24T07:56:50.024115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987569+0000","last_change":"2023-11-24T07:56:49.999624+0000","last_active":"2023-11-24T07:56:50.987569+0000","last_peered":"2023-11-24T07:56:50.987569+0000","last_clean":"2023-11-24T07:56:50.987569+0000","last_became_active":"2023-11-24T07:56:49.999370+0000","last_became_peered":"2023-11-24T07:56:49.999370+0000","last_unstale":"2023-11-24T07:56:50.987569+0000","last_undegraded":"2023-11-24T07:56:50.987569+0000","last_fullsized":"2023-11-24T07:56:50.987569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988066+0000","last_change":"2023-11-24T07:56:49.999092+0000","last_active":"2023-11-24T07:56:50.988066+0000","last_peered":"2023-11-24T07:56:50.988066+0000","last_clean":"2023-11-24T07:56:50.988066+0000","last_became_active":"2023-11-24T07:56:49.998578+0000","last_became_peered":"2023-11-24T07:56:49.998578+0000","last_unstale":"2023-11-24T07:56:50.988066+0000","last_undegraded":"2023-11-24T07:56:50.988066+0000","last_fullsized":"2023-11-24T07:56:50.988066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988332+0000","last_change":"2023-11-24T07:56:50.016980+0000","last_active":"2023-11-24T07:56:50.988332+0000","last_peered":"2023-11-24T07:56:50.988332+0000","last_clean":"2023-11-24T07:56:50.988332+0000","last_became_active":"2023-11-24T07:56:50.016704+0000","last_became_peered":"2023-11-24T07:56:50.016704+0000","last_unstale":"2023-11-24T07:56:50.988332+0000","last_undegraded":"2023-11-24T07:56:50.988332+0000","last_fullsized":"2023-11-24T07:56:50.988332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:13.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014744+0000","last_change":"2023-11-24T07:56:50.010849+0000","last_active":"2023-11-24T07:56:50.014744+0000","last_peered":"2023-11-24T07:56:50.014744+0000","last_clean":"2023-11-24T07:56:50.014744+0000","last_became_active":"2023-11-24T07:56:50.010479+0000","last_became_peered":"2023-11-24T07:56:50.010479+0000","last_unstale":"2023-11-24T07:56:50.014744+0000","last_undegraded":"2023-11-24T07:56:50.014744+0000","last_fullsized":"2023-11-24T07:56:50.014744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:12.475852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018935+0000","last_change":"2023-11-24T07:56:50.016938+0000","last_active":"2023-11-24T07:56:50.018935+0000","last_peered":"2023-11-24T07:56:50.018935+0000","last_clean":"2023-11-24T07:56:50.018935+0000","last_became_active":"2023-11-24T07:56:50.016537+0000","last_became_peered":"2023-11-24T07:56:50.016537+0000","last_unstale":"2023-11-24T07:56:50.018935+0000","last_undegraded":"2023-11-24T07:56:50.018935+0000","last_fullsized":"2023-11-24T07:56:50.018935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986876+0000","last_change":"2023-11-24T07:56:49.989957+0000","last_active":"2023-11-24T07:56:50.986876+0000","last_peered":"2023-11-24T07:56:50.986876+0000","last_clean":"2023-11-24T07:56:50.986876+0000","last_became_active":"2023-11-24T07:56:49.989604+0000","last_became_peered":"2023-11-24T07:56:49.989604+0000","last_unstale":"2023-11-24T07:56:50.986876+0000","last_undegraded":"2023-11-24T07:56:50.986876+0000","last_fullsized":"2023-11-24T07:56:50.986876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988569+0000","last_change":"2023-11-24T07:56:49.988221+0000","last_active":"2023-11-24T07:56:50.988569+0000","last_peered":"2023-11-24T07:56:50.988569+0000","last_clean":"2023-11-24T07:56:50.988569+0000","last_became_active":"2023-11-24T07:56:49.987909+0000","last_became_peered":"2023-11-24T07:56:49.987909+0000","last_unstale":"2023-11-24T07:56:50.988569+0000","last_undegraded":"2023-11-24T07:56:50.988569+0000","last_fullsized":"2023-11-24T07:56:50.988569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994190+0000","last_change":"2023-11-24T07:56:49.987632+0000","last_active":"2023-11-24T07:56:49.994190+0000","last_peered":"2023-11-24T07:56:49.994190+0000","last_clean":"2023-11-24T07:56:49.994190+0000","last_became_active":"2023-11-24T07:56:49.983904+0000","last_became_peered":"2023-11-24T07:56:49.983904+0000","last_unstale":"2023-11-24T07:56:49.994190+0000","last_undegraded":"2023-11-24T07:56:49.994190+0000","last_fullsized":"2023-11-24T07:56:49.994190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:54.518837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995667+0000","last_change":"2023-11-24T07:56:49.993099+0000","last_active":"2023-11-24T07:56:49.995667+0000","last_peered":"2023-11-24T07:56:49.995667+0000","last_clean":"2023-11-24T07:56:49.995667+0000","last_became_active":"2023-11-24T07:56:49.992805+0000","last_became_peered":"2023-11-24T07:56:49.992805+0000","last_unstale":"2023-11-24T07:56:49.995667+0000","last_undegraded":"2023-11-24T07:56:49.995667+0000","last_fullsized":"2023-11-24T07:56:49.995667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023924+0000","last_change":"2023-11-24T07:56:49.996222+0000","last_active":"2023-11-24T07:56:50.023924+0000","last_peered":"2023-11-24T07:56:50.023924+0000","last_clean":"2023-11-24T07:56:50.023924+0000","last_became_active":"2023-11-24T07:56:49.995849+0000","last_became_peered":"2023-11-24T07:56:49.995849+0000","last_unstale":"2023-11-24T07:56:50.023924+0000","last_undegraded":"2023-11-24T07:56:50.023924+0000","last_fullsized":"2023-11-24T07:56:50.023924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024237+0000","last_change":"2023-11-24T07:56:50.016330+0000","last_active":"2023-11-24T07:56:50.024237+0000","last_peered":"2023-11-24T07:56:50.024237+0000","last_clean":"2023-11-24T07:56:50.024237+0000","last_became_active":"2023-11-24T07:56:50.016061+0000","last_became_peered":"2023-11-24T07:56:50.016061+0000","last_unstale":"2023-11-24T07:56:50.024237+0000","last_undegraded":"2023-11-24T07:56:50.024237+0000","last_fullsized":"2023-11-24T07:56:50.024237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:02.354677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.997628+0000","last_change":"2023-11-24T07:56:49.995710+0000","last_active":"2023-11-24T07:56:49.997628+0000","last_peered":"2023-11-24T07:56:49.997628+0000","last_clean":"2023-11-24T07:56:49.997628+0000","last_became_active":"2023-11-24T07:56:49.995395+0000","last_became_peered":"2023-11-24T07:56:49.995395+0000","last_unstale":"2023-11-24T07:56:49.997628+0000","last_undegraded":"2023-11-24T07:56:49.997628+0000","last_fullsized":"2023-11-24T07:56:49.997628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988254+0000","last_change":"2023-11-24T07:56:49.987938+0000","last_active":"2023-11-24T07:56:50.988254+0000","last_peered":"2023-11-24T07:56:50.988254+0000","last_clean":"2023-11-24T07:56:50.988254+0000","last_became_active":"2023-11-24T07:56:49.987515+0000","last_became_peered":"2023-11-24T07:56:49.987515+0000","last_unstale":"2023-11-24T07:56:50.988254+0000","last_undegraded":"2023-11-24T07:56:50.988254+0000","last_fullsized":"2023-11-24T07:56:50.988254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995874+0000","last_change":"2023-11-24T07:56:49.994082+0000","last_active":"2023-11-24T07:56:49.995874+0000","last_peered":"2023-11-24T07:56:49.995874+0000","last_clean":"2023-11-24T07:56:49.995874+0000","last_became_active":"2023-11-24T07:56:49.993509+0000","last_became_peered":"2023-11-24T07:56:49.993509+0000","last_unstale":"2023-11-24T07:56:49.995874+0000","last_undegraded":"2023-11-24T07:56:49.995874+0000","last_fullsized":"2023-11-24T07:56:49.995874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994516+0000","last_change":"2023-11-24T07:56:49.981227+0000","last_active":"2023-11-24T07:56:49.994516+0000","last_peered":"2023-11-24T07:56:49.994516+0000","last_clean":"2023-11-24T07:56:49.994516+0000","last_became_active":"2023-11-24T07:56:49.980964+0000","last_became_peered":"2023-11-24T07:56:49.980964+0000","last_unstale":"2023-11-24T07:56:49.994516+0000","last_undegraded":"2023-11-24T07:56:49.994516+0000","last_fullsized":"2023-11-24T07:56:49.994516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:00.102887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024148+0000","last_change":"2023-11-24T07:56:50.009118+0000","last_active":"2023-11-24T07:56:50.024148+0000","last_peered":"2023-11-24T07:56:50.024148+0000","last_clean":"2023-11-24T07:56:50.024148+0000","last_became_active":"2023-11-24T07:56:50.008914+0000","last_became_peered":"2023-11-24T07:56:50.008914+0000","last_unstale":"2023-11-24T07:56:50.024148+0000","last_undegraded":"2023-11-24T07:56:50.024148+0000","last_fullsized":"2023-11-24T07:56:50.024148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988096+0000","last_change":"2023-11-24T07:56:49.993617+0000","last_active":"2023-11-24T07:56:50.988096+0000","last_peered":"2023-11-24T07:56:50.988096+0000","last_clean":"2023-11-24T07:56:50.988096+0000","last_became_active":"2023-11-24T07:56:49.993342+0000","last_became_peered":"2023-11-24T07:56:49.993342+0000","last_unstale":"2023-11-24T07:56:50.988096+0000","last_undegraded":"2023-11-24T07:56:50.988096+0000","last_fullsized":"2023-11-24T07:56:50.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.008741+0000","last_change":"2023-11-24T07:56:49.987374+0000","last_active":"2023-11-24T07:56:50.008741+0000","last_peered":"2023-11-24T07:56:50.008741+0000","last_clean":"2023-11-24T07:56:50.008741+0000","last_became_active":"2023-11-24T07:56:49.987072+0000","last_became_peered":"2023-11-24T07:56:49.987072+0000","last_unstale":"2023-11-24T07:56:50.008741+0000","last_undegraded":"2023-11-24T07:56:50.008741+0000","last_fullsized":"2023-11-24T07:56:50.008741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989129+0000","last_change":"2023-11-24T07:56:50.007415+0000","last_active":"2023-11-24T07:56:50.989129+0000","last_peered":"2023-11-24T07:56:50.989129+0000","last_clean":"2023-11-24T07:56:50.989129+0000","last_became_active":"2023-11-24T07:56:50.007143+0000","last_became_peered":"2023-11-24T07:56:50.007143+0000","last_unstale":"2023-11-24T07:56:50.989129+0000","last_undegraded":"2023-11-24T07:56:50.989129+0000","last_fullsized":"2023-11-24T07:56:50.989129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994779+0000","last_change":"2023-11-24T07:56:49.992073+0000","last_active":"2023-11-24T07:56:49.994779+0000","last_peered":"2023-11-24T07:56:49.994779+0000","last_clean":"2023-11-24T07:56:49.994779+0000","last_became_active":"2023-11-24T07:56:49.991751+0000","last_became_peered":"2023-11-24T07:56:49.991751+0000","last_unstale":"2023-11-24T07:56:49.994779+0000","last_undegraded":"2023-11-24T07:56:49.994779+0000","last_fullsized":"2023-11-24T07:56:49.994779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.993367+0000","last_change":"2023-11-24T07:56:49.991019+0000","last_active":"2023-11-24T07:56:49.993367+0000","last_peered":"2023-11-24T07:56:49.993367+0000","last_clean":"2023-11-24T07:56:49.993367+0000","last_became_active":"2023-11-24T07:56:49.990710+0000","last_became_peered":"2023-11-24T07:56:49.990710+0000","last_unstale":"2023-11-24T07:56:49.993367+0000","last_undegraded":"2023-11-24T07:56:49.993367+0000","last_fullsized":"2023-11-24T07:56:49.993367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988686+0000","last_change":"2023-11-24T07:56:50.007449+0000","last_active":"2023-11-24T07:56:50.988686+0000","last_peered":"2023-11-24T07:56:50.988686+0000","last_clean":"2023-11-24T07:56:50.988686+0000","last_became_active":"2023-11-24T07:56:50.007205+0000","last_became_peered":"2023-11-24T07:56:50.007205+0000","last_unstale":"2023-11-24T07:56:50.988686+0000","last_undegraded":"2023-11-24T07:56:50.988686+0000","last_fullsized":"2023-11-24T07:56:50.988686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.997211+0000","last_change":"2023-11-24T07:56:49.991939+0000","last_active":"2023-11-24T07:56:49.997211+0000","last_peered":"2023-11-24T07:56:49.997211+0000","last_clean":"2023-11-24T07:56:49.997211+0000","last_became_active":"2023-11-24T07:56:49.991553+0000","last_became_peered":"2023-11-24T07:56:49.991553+0000","last_unstale":"2023-11-24T07:56:49.997211+0000","last_undegraded":"2023-11-24T07:56:49.997211+0000","last_fullsized":"2023-11-24T07:56:49.997211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:15.591408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023890+0000","last_change":"2023-11-24T07:56:49.996135+0000","last_active":"2023-11-24T07:56:50.023890+0000","last_peered":"2023-11-24T07:56:50.023890+0000","last_clean":"2023-11-24T07:56:50.023890+0000","last_became_active":"2023-11-24T07:56:49.995502+0000","last_became_peered":"2023-11-24T07:56:49.995502+0000","last_unstale":"2023-11-24T07:56:50.023890+0000","last_undegraded":"2023-11-24T07:56:50.023890+0000","last_fullsized":"2023-11-24T07:56:50.023890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000773+0000","last_change":"2023-11-24T07:56:49.999799+0000","last_active":"2023-11-24T07:56:50.000773+0000","last_peered":"2023-11-24T07:56:50.000773+0000","last_clean":"2023-11-24T07:56:50.000773+0000","last_became_active":"2023-11-24T07:56:49.999461+0000","last_became_peered":"2023-11-24T07:56:49.999461+0000","last_unstale":"2023-11-24T07:56:50.000773+0000","last_undegraded":"2023-11-24T07:56:50.000773+0000","last_fullsized":"2023-11-24T07:56:50.000773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014686+0000","last_change":"2023-11-24T07:56:50.006284+0000","last_active":"2023-11-24T07:56:50.014686+0000","last_peered":"2023-11-24T07:56:50.014686+0000","last_clean":"2023-11-24T07:56:50.014686+0000","last_became_active":"2023-11-24T07:56:50.005181+0000","last_became_peered":"2023-11-24T07:56:50.005181+0000","last_unstale":"2023-11-24T07:56:50.014686+0000","last_undegraded":"2023-11-24T07:56:50.014686+0000","last_fullsized":"2023-11-24T07:56:50.014686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986518+0000","last_change":"2023-11-24T07:56:49.982685+0000","last_active":"2023-11-24T07:56:50.986518+0000","last_peered":"2023-11-24T07:56:50.986518+0000","last_clean":"2023-11-24T07:56:50.986518+0000","last_became_active":"2023-11-24T07:56:49.982396+0000","last_became_peered":"2023-11-24T07:56:49.982396+0000","last_unstale":"2023-11-24T07:56:50.986518+0000","last_undegraded":"2023-11-24T07:56:50.986518+0000","last_fullsized":"2023-11-24T07:56:50.986518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988660+0000","last_change":"2023-11-24T07:56:48.997228+0000","last_active":"2023-11-24T07:56:50.988660+0000","last_peered":"2023-11-24T07:56:50.988660+0000","last_clean":"2023-11-24T07:56:50.988660+0000","last_became_active":"2023-11-24T07:56:48.996544+0000","last_became_peered":"2023-11-24T07:56:48.996544+0000","last_unstale":"2023-11-24T07:56:50.988660+0000","last_undegraded":"2023-11-24T07:56:50.988660+0000","last_fullsized":"2023-11-24T07:56:50.988660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.999525+0000","last_change":"2023-11-24T07:56:49.994392+0000","last_active":"2023-11-24T07:56:49.999525+0000","last_peered":"2023-11-24T07:56:49.999525+0000","last_clean":"2023-11-24T07:56:49.999525+0000","last_became_active":"2023-11-24T07:56:49.991942+0000","last_became_peered":"2023-11-24T07:56:49.991942+0000","last_unstale":"2023-11-24T07:56:49.999525+0000","last_undegraded":"2023-11-24T07:56:49.999525+0000","last_fullsized":"2023-11-24T07:56:49.999525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.009368+0000","last_change":"2023-11-24T07:56:48.990750+0000","last_active":"2023-11-24T07:56:50.009368+0000","last_peered":"2023-11-24T07:56:50.009368+0000","last_clean":"2023-11-24T07:56:50.009368+0000","last_became_active":"2023-11-24T07:56:48.990336+0000","last_became_peered":"2023-11-24T07:56:48.990336+0000","last_unstale":"2023-11-24T07:56:50.009368+0000","last_undegraded":"2023-11-24T07:56:50.009368+0000","last_fullsized":"2023-11-24T07:56:50.009368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988186+0000","last_change":"2023-11-24T07:56:48.996558+0000","last_active":"2023-11-24T07:56:50.988186+0000","last_peered":"2023-11-24T07:56:50.988186+0000","last_clean":"2023-11-24T07:56:50.988186+0000","last_became_active":"2023-11-24T07:56:48.996277+0000","last_became_peered":"2023-11-24T07:56:48.996277+0000","last_unstale":"2023-11-24T07:56:50.988186+0000","last_undegraded":"2023-11-24T07:56:50.988186+0000","last_fullsized":"2023-11-24T07:56:50.988186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988149+0000","last_change":"2023-11-24T07:56:49.990169+0000","last_active":"2023-11-24T07:56:50.988149+0000","last_peered":"2023-11-24T07:56:50.988149+0000","last_clean":"2023-11-24T07:56:50.988149+0000","last_became_active":"2023-11-24T07:56:49.989887+0000","last_became_peered":"2023-11-24T07:56:49.989887+0000","last_unstale":"2023-11-24T07:56:50.988149+0000","last_undegraded":"2023-11-24T07:56:50.988149+0000","last_fullsized":"2023-11-24T07:56:50.988149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.988241+0000","last_change":"2023-11-24T07:56:48.988849+0000","last_active":"2023-11-24T07:56:49.988241+0000","last_peered":"2023-11-24T07:56:49.988241+0000","last_clean":"2023-11-24T07:56:49.988241+0000","last_became_active":"2023-11-24T07:56:48.988481+0000","last_became_peered":"2023-11-24T07:56:48.988481+0000","last_unstale":"2023-11-24T07:56:49.988241+0000","last_undegraded":"2023-11-24T07:56:49.988241+0000","last_fullsized":"2023-11-24T07:56:49.988241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000912+0000","last_change":"2023-11-24T07:56:49.998134+0000","last_active":"2023-11-24T07:56:50.000912+0000","last_peered":"2023-11-24T07:56:50.000912+0000","last_clean":"2023-11-24T07:56:50.000912+0000","last_became_active":"2023-11-24T07:56:49.997733+0000","last_became_peered":"2023-11-24T07:56:49.997733+0000","last_unstale":"2023-11-24T07:56:50.000912+0000","last_undegraded":"2023-11-24T07:56:50.000912+0000","last_fullsized":"2023-11-24T07:56:50.000912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.979666+0000","last_change":"2023-11-24T07:56:48.996333+0000","last_active":"2023-11-24T07:56:49.979666+0000","last_peered":"2023-11-24T07:56:49.979666+0000","last_clean":"2023-11-24T07:56:49.979666+0000","last_became_active":"2023-11-24T07:56:48.995991+0000","last_became_peered":"2023-11-24T07:56:48.995991+0000","last_unstale":"2023-11-24T07:56:49.979666+0000","last_undegraded":"2023-11-24T07:56:49.979666+0000","last_fullsized":"2023-11-24T07:56:49.979666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024210+0000","last_change":"2023-11-24T07:56:50.009044+0000","last_active":"2023-11-24T07:56:50.024210+0000","last_peered":"2023-11-24T07:56:50.024210+0000","last_clean":"2023-11-24T07:56:50.024210+0000","last_became_active":"2023-11-24T07:56:50.008572+0000","last_became_peered":"2023-11-24T07:56:50.008572+0000","last_unstale":"2023-11-24T07:56:50.024210+0000","last_undegraded":"2023-11-24T07:56:50.024210+0000","last_fullsized":"2023-11-24T07:56:50.024210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:09.056215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995837+0000","last_change":"2023-11-24T07:56:48.994794+0000","last_active":"2023-11-24T07:56:49.995837+0000","last_peered":"2023-11-24T07:56:49.995837+0000","last_clean":"2023-11-24T07:56:49.995837+0000","last_became_active":"2023-11-24T07:56:48.994353+0000","last_became_peered":"2023-11-24T07:56:48.994353+0000","last_unstale":"2023-11-24T07:56:49.995837+0000","last_undegraded":"2023-11-24T07:56:49.995837+0000","last_fullsized":"2023-11-24T07:56:49.995837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000614+0000","last_change":"2023-11-24T07:56:49.999054+0000","last_active":"2023-11-24T07:56:50.000614+0000","last_peered":"2023-11-24T07:56:50.000614+0000","last_clean":"2023-11-24T07:56:50.000614+0000","last_became_active":"2023-11-24T07:56:49.998590+0000","last_became_peered":"2023-11-24T07:56:49.998590+0000","last_unstale":"2023-11-24T07:56:50.000614+0000","last_undegraded":"2023-11-24T07:56:50.000614+0000","last_fullsized":"2023-11-24T07:56:50.000614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.026997+0000","last_change":"2023-11-24T07:56:49.000118+0000","last_active":"2023-11-24T07:56:50.026997+0000","last_peered":"2023-11-24T07:56:50.026997+0000","last_clean":"2023-11-24T07:56:50.026997+0000","last_became_active":"2023-11-24T07:56:48.999794+0000","last_became_peered":"2023-11-24T07:56:48.999794+0000","last_unstale":"2023-11-24T07:56:50.026997+0000","last_undegraded":"2023-11-24T07:56:50.026997+0000","last_fullsized":"2023-11-24T07:56:50.026997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986815+0000","last_change":"2023-11-24T07:56:49.989959+0000","last_active":"2023-11-24T07:56:50.986815+0000","last_peered":"2023-11-24T07:56:50.986815+0000","last_clean":"2023-11-24T07:56:50.986815+0000","last_became_active":"2023-11-24T07:56:49.989687+0000","last_became_peered":"2023-11-24T07:56:49.989687+0000","last_unstale":"2023-11-24T07:56:50.986815+0000","last_undegraded":"2023-11-24T07:56:50.986815+0000","last_fullsized":"2023-11-24T07:56:50.986815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018918+0000","last_change":"2023-11-24T07:56:48.988881+0000","last_active":"2023-11-24T07:56:50.018918+0000","last_peered":"2023-11-24T07:56:50.018918+0000","last_clean":"2023-11-24T07:56:50.018918+0000","last_became_active":"2023-11-24T07:56:48.988590+0000","last_became_peered":"2023-11-24T07:56:48.988590+0000","last_unstale":"2023-11-24T07:56:50.018918+0000","last_undegraded":"2023-11-24T07:56:50.018918+0000","last_fullsized":"2023-11-24T07:56:50.018918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987903+0000","last_change":"2023-11-24T07:56:49.985992+0000","last_active":"2023-11-24T07:56:50.987903+0000","last_peered":"2023-11-24T07:56:50.987903+0000","last_clean":"2023-11-24T07:56:50.987903+0000","last_became_active":"2023-11-24T07:56:49.985719+0000","last_became_peered":"2023-11-24T07:56:49.985719+0000","last_unstale":"2023-11-24T07:56:50.987903+0000","last_undegraded":"2023-11-24T07:56:50.987903+0000","last_fullsized":"2023-11-24T07:56:50.987903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.017899+0000","last_change":"2023-11-24T07:56:48.986496+0000","last_active":"2023-11-24T07:56:50.017899+0000","last_peered":"2023-11-24T07:56:50.017899+0000","last_clean":"2023-11-24T07:56:50.017899+0000","last_became_active":"2023-11-24T07:56:48.986172+0000","last_became_peered":"2023-11-24T07:56:48.986172+0000","last_unstale":"2023-11-24T07:56:50.017899+0000","last_undegraded":"2023-11-24T07:56:50.017899+0000","last_fullsized":"2023-11-24T07:56:50.017899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.992302+0000","last_change":"2023-11-24T07:56:49.979739+0000","last_active":"2023-11-24T07:56:49.992302+0000","last_peered":"2023-11-24T07:56:49.992302+0000","last_clean":"2023-11-24T07:56:49.992302+0000","last_became_active":"2023-11-24T07:56:49.979473+0000","last_became_peered":"2023-11-24T07:56:49.979473+0000","last_unstale":"2023-11-24T07:56:49.992302+0000","last_undegraded":"2023-11-24T07:56:49.992302+0000","last_fullsized":"2023-11-24T07:56:49.992302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.996019+0000","last_change":"2023-11-24T07:56:48.989819+0000","last_active":"2023-11-24T07:56:49.996019+0000","last_peered":"2023-11-24T07:56:49.996019+0000","last_clean":"2023-11-24T07:56:49.996019+0000","last_became_active":"2023-11-24T07:56:48.989226+0000","last_became_peered":"2023-11-24T07:56:48.989226+0000","last_unstale":"2023-11-24T07:56:49.996019+0000","last_undegraded":"2023-11-24T07:56:49.996019+0000","last_fullsized":"2023-11-24T07:56:49.996019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:44.234559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987828+0000","last_change":"2023-11-24T07:56:49.990806+0000","last_active":"2023-11-24T07:56:50.987828+0000","last_peered":"2023-11-24T07:56:50.987828+0000","last_clean":"2023-11-24T07:56:50.987828+0000","last_became_active":"2023-11-24T07:56:49.990478+0000","last_became_peered":"2023-11-24T07:56:49.990478+0000","last_unstale":"2023-11-24T07:56:50.987828+0000","last_undegraded":"2023-11-24T07:56:50.987828+0000","last_fullsized":"2023-11-24T07:56:50.987828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977982+0000","last_change":"2023-11-24T07:56:48.987232+0000","last_active":"2023-11-24T07:56:49.977982+0000","last_peered":"2023-11-24T07:56:49.977982+0000","last_clean":"2023-11-24T07:56:49.977982+0000","last_became_active":"2023-11-24T07:56:48.986874+0000","last_became_peered":"2023-11-24T07:56:48.986874+0000","last_unstale":"2023-11-24T07:56:49.977982+0000","last_undegraded":"2023-11-24T07:56:49.977982+0000","last_fullsized":"2023-11-24T07:56:49.977982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014669+0000","last_change":"2023-11-24T07:56:50.005621+0000","last_active":"2023-11-24T07:56:50.014669+0000","last_peered":"2023-11-24T07:56:50.014669+0000","last_clean":"2023-11-24T07:56:50.014669+0000","last_became_active":"2023-11-24T07:56:50.004796+0000","last_became_peered":"2023-11-24T07:56:50.004796+0000","last_unstale":"2023-11-24T07:56:50.014669+0000","last_undegraded":"2023-11-24T07:56:50.014669+0000","last_fullsized":"2023-11-24T07:56:50.014669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.016381+0000","last_change":"2023-11-24T07:56:48.982818+0000","last_active":"2023-11-24T07:56:50.016381+0000","last_peered":"2023-11-24T07:56:50.016381+0000","last_clean":"2023-11-24T07:56:50.016381+0000","last_became_active":"2023-11-24T07:56:48.982473+0000","last_became_peered":"2023-11-24T07:56:48.982473+0000","last_unstale":"2023-11-24T07:56:50.016381+0000","last_undegraded":"2023-11-24T07:56:50.016381+0000","last_fullsized":"2023-11-24T07:56:50.016381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:40.373215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987624+0000","last_change":"2023-11-24T07:56:49.990672+0000","last_active":"2023-11-24T07:56:50.987624+0000","last_peered":"2023-11-24T07:56:50.987624+0000","last_clean":"2023-11-24T07:56:50.987624+0000","last_became_active":"2023-11-24T07:56:49.990376+0000","last_became_peered":"2023-11-24T07:56:49.990376+0000","last_unstale":"2023-11-24T07:56:50.987624+0000","last_undegraded":"2023-11-24T07:56:50.987624+0000","last_fullsized":"2023-11-24T07:56:50.987624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986880+0000","last_change":"2023-11-24T07:56:48.988508+0000","last_active":"2023-11-24T07:56:50.986880+0000","last_peered":"2023-11-24T07:56:50.986880+0000","last_clean":"2023-11-24T07:56:50.986880+0000","last_became_active":"2023-11-24T07:56:48.988087+0000","last_became_peered":"2023-11-24T07:56:48.988087+0000","last_unstale":"2023-11-24T07:56:50.986880+0000","last_undegraded":"2023-11-24T07:56:50.986880+0000","last_fullsized":"2023-11-24T07:56:50.986880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:06.606043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987995+0000","last_change":"2023-11-24T07:56:49.990816+0000","last_active":"2023-11-24T07:56:50.987995+0000","last_peered":"2023-11-24T07:56:50.987995+0000","last_clean":"2023-11-24T07:56:50.987995+0000","last_became_active":"2023-11-24T07:56:49.990509+0000","last_became_peered":"2023-11-24T07:56:49.990509+0000","last_unstale":"2023-11-24T07:56:50.987995+0000","last_undegraded":"2023-11-24T07:56:50.987995+0000","last_fullsized":"2023-11-24T07:56:50.987995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014876+0000","last_change":"2023-11-24T07:56:48.992645+0000","last_active":"2023-11-24T07:56:50.014876+0000","last_peered":"2023-11-24T07:56:50.014876+0000","last_clean":"2023-11-24T07:56:50.014876+0000","last_became_active":"2023-11-24T07:56:48.992283+0000","last_became_peered":"2023-11-24T07:56:48.992283+0000","last_unstale":"2023-11-24T07:56:50.014876+0000","last_undegraded":"2023-11-24T07:56:50.014876+0000","last_fullsized":"2023-11-24T07:56:50.014876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:53.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988381+0000","last_change":"2023-11-24T07:56:49.993271+0000","last_active":"2023-11-24T07:56:50.988381+0000","last_peered":"2023-11-24T07:56:50.988381+0000","last_clean":"2023-11-24T07:56:50.988381+0000","last_became_active":"2023-11-24T07:56:49.992353+0000","last_became_peered":"2023-11-24T07:56:49.992353+0000","last_unstale":"2023-11-24T07:56:50.988381+0000","last_undegraded":"2023-11-24T07:56:50.988381+0000","last_fullsized":"2023-11-24T07:56:50.988381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:59.074191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.010201+0000","last_change":"2023-11-24T07:56:48.984821+0000","last_active":"2023-11-24T07:56:50.010201+0000","last_peered":"2023-11-24T07:56:50.010201+0000","last_clean":"2023-11-24T07:56:50.010201+0000","last_became_active":"2023-11-24T07:56:48.984545+0000","last_became_peered":"2023-11-24T07:56:48.984545+0000","last_unstale":"2023-11-24T07:56:50.010201+0000","last_undegraded":"2023-11-24T07:56:50.010201+0000","last_fullsized":"2023-11-24T07:56:50.010201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.020243+0000","last_change":"2023-11-24T07:56:49.994668+0000","last_active":"2023-11-24T07:56:50.020243+0000","last_peered":"2023-11-24T07:56:50.020243+0000","last_clean":"2023-11-24T07:56:50.020243+0000","last_became_active":"2023-11-24T07:56:49.993993+0000","last_became_peered":"2023-11-24T07:56:49.993993+0000","last_unstale":"2023-11-24T07:56:50.020243+0000","last_undegraded":"2023-11-24T07:56:50.020243+0000","last_fullsized":"2023-11-24T07:56:50.020243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:15.591408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.974733+0000","last_change":"2023-11-24T07:56:48.997388+0000","last_active":"2023-11-24T07:56:49.974733+0000","last_peered":"2023-11-24T07:56:49.974733+0000","last_clean":"2023-11-24T07:56:49.974733+0000","last_became_active":"2023-11-24T07:56:48.997143+0000","last_became_peered":"2023-11-24T07:56:48.997143+0000","last_unstale":"2023-11-24T07:56:49.974733+0000","last_undegraded":"2023-11-24T07:56:49.974733+0000","last_fullsized":"2023-11-24T07:56:49.974733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988126+0000","last_change":"2023-11-24T07:56:50.017444+0000","last_active":"2023-11-24T07:56:50.988126+0000","last_peered":"2023-11-24T07:56:50.988126+0000","last_clean":"2023-11-24T07:56:50.988126+0000","last_became_active":"2023-11-24T07:56:50.017218+0000","last_became_peered":"2023-11-24T07:56:50.017218+0000","last_unstale":"2023-11-24T07:56:50.988126+0000","last_undegraded":"2023-11-24T07:56:50.988126+0000","last_fullsized":"2023-11-24T07:56:50.988126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.973044+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:56:49.973044+0000","last_peered":"2023-11-24T07:56:49.973044+0000","last_clean":"2023-11-24T07:56:49.973044+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:56:49.973044+0000","last_undegraded":"2023-11-24T07:56:49.973044+0000","last_fullsized":"2023-11-24T07:56:49.973044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.996018+0000","last_change":"2023-11-24T07:56:48.992283+0000","last_active":"2023-11-24T07:56:49.996018+0000","last_peered":"2023-11-24T07:56:49.996018+0000","last_clean":"2023-11-24T07:56:49.996018+0000","last_became_active":"2023-11-24T07:56:48.991808+0000","last_became_peered":"2023-11-24T07:56:48.991808+0000","last_unstale":"2023-11-24T07:56:49.996018+0000","last_undegraded":"2023-11-24T07:56:49.996018+0000","last_fullsized":"2023-11-24T07:56:49.996018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:24.480996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988271+0000","last_change":"2023-11-24T07:56:50.020101+0000","last_active":"2023-11-24T07:56:50.988271+0000","last_peered":"2023-11-24T07:56:50.988271+0000","last_clean":"2023-11-24T07:56:50.988271+0000","last_became_active":"2023-11-24T07:56:50.019553+0000","last_became_peered":"2023-11-24T07:56:50.019553+0000","last_unstale":"2023-11-24T07:56:50.988271+0000","last_undegraded":"2023-11-24T07:56:50.988271+0000","last_fullsized":"2023-11-24T07:56:50.988271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987627+0000","last_change":"2023-11-24T07:56:48.982233+0000","last_active":"2023-11-24T07:56:50.987627+0000","last_peered":"2023-11-24T07:56:50.987627+0000","last_clean":"2023-11-24T07:56:50.987627+0000","last_became_active":"2023-11-24T07:56:48.981854+0000","last_became_peered":"2023-11-24T07:56:48.981854+0000","last_unstale":"2023-11-24T07:56:50.987627+0000","last_undegraded":"2023-11-24T07:56:50.987627+0000","last_fullsized":"2023-11-24T07:56:50.987627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994297+0000","last_change":"2023-11-24T07:56:49.983532+0000","last_active":"2023-11-24T07:56:49.994297+0000","last_peered":"2023-11-24T07:56:49.994297+0000","last_clean":"2023-11-24T07:56:49.994297+0000","last_became_active":"2023-11-24T07:56:49.983242+0000","last_became_peered":"2023-11-24T07:56:49.983242+0000","last_unstale":"2023-11-24T07:56:49.994297+0000","last_undegraded":"2023-11-24T07:56:49.994297+0000","last_fullsized":"2023-11-24T07:56:49.994297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:44.819411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.974236+0000","last_change":"2023-11-24T07:56:48.992743+0000","last_active":"2023-11-24T07:56:49.974236+0000","last_peered":"2023-11-24T07:56:49.974236+0000","last_clean":"2023-11-24T07:56:49.974236+0000","last_became_active":"2023-11-24T07:56:48.992300+0000","last_became_peered":"2023-11-24T07:56:48.992300+0000","last_unstale":"2023-11-24T07:56:49.974236+0000","last_undegraded":"2023-11-24T07:56:49.974236+0000","last_fullsized":"2023-11-24T07:56:49.974236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.985003+0000","last_change":"2023-11-24T07:56:49.981866+0000","last_active":"2023-11-24T07:56:49.985003+0000","last_peered":"2023-11-24T07:56:49.985003+0000","last_clean":"2023-11-24T07:56:49.985003+0000","last_became_active":"2023-11-24T07:56:49.981342+0000","last_became_peered":"2023-11-24T07:56:49.981342+0000","last_unstale":"2023-11-24T07:56:49.985003+0000","last_undegraded":"2023-11-24T07:56:49.985003+0000","last_fullsized":"2023-11-24T07:56:49.985003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995950+0000","last_change":"2023-11-24T07:56:48.993830+0000","last_active":"2023-11-24T07:56:49.995950+0000","last_peered":"2023-11-24T07:56:49.995950+0000","last_clean":"2023-11-24T07:56:49.995950+0000","last_became_active":"2023-11-24T07:56:48.991880+0000","last_became_peered":"2023-11-24T07:56:48.991880+0000","last_unstale":"2023-11-24T07:56:49.995950+0000","last_undegraded":"2023-11-24T07:56:49.995950+0000","last_fullsized":"2023-11-24T07:56:49.995950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986711+0000","last_change":"2023-11-24T07:56:50.002741+0000","last_active":"2023-11-24T07:56:50.986711+0000","last_peered":"2023-11-24T07:56:50.986711+0000","last_clean":"2023-11-24T07:56:50.986711+0000","last_became_active":"2023-11-24T07:56:49.994282+0000","last_became_peered":"2023-11-24T07:56:49.994282+0000","last_unstale":"2023-11-24T07:56:50.986711+0000","last_undegraded":"2023-11-24T07:56:50.986711+0000","last_fullsized":"2023-11-24T07:56:50.986711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977339+0000","last_change":"2023-11-24T07:56:48.988654+0000","last_active":"2023-11-24T07:56:49.977339+0000","last_peered":"2023-11-24T07:56:49.977339+0000","last_clean":"2023-11-24T07:56:49.977339+0000","last_became_active":"2023-11-24T07:56:48.988250+0000","last_became_peered":"2023-11-24T07:56:48.988250+0000","last_unstale":"2023-11-24T07:56:49.977339+0000","last_undegraded":"2023-11-24T07:56:49.977339+0000","last_fullsized":"2023-11-24T07:56:49.977339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024027+0000","last_change":"2023-11-24T07:56:50.001254+0000","last_active":"2023-11-24T07:56:50.024027+0000","last_peered":"2023-11-24T07:56:50.024027+0000","last_clean":"2023-11-24T07:56:50.024027+0000","last_became_active":"2023-11-24T07:56:49.996268+0000","last_became_peered":"2023-11-24T07:56:49.996268+0000","last_unstale":"2023-11-24T07:56:50.024027+0000","last_undegraded":"2023-11-24T07:56:50.024027+0000","last_fullsized":"2023-11-24T07:56:50.024027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:48.183813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988286+0000","last_change":"2023-11-24T07:56:48.991678+0000","last_active":"2023-11-24T07:56:50.988286+0000","last_peered":"2023-11-24T07:56:50.988286+0000","last_clean":"2023-11-24T07:56:50.988286+0000","last_became_active":"2023-11-24T07:56:48.991306+0000","last_became_peered":"2023-11-24T07:56:48.991306+0000","last_unstale":"2023-11-24T07:56:50.988286+0000","last_undegraded":"2023-11-24T07:56:50.988286+0000","last_fullsized":"2023-11-24T07:56:50.988286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.992493+0000","last_change":"2023-11-24T07:56:49.983208+0000","last_active":"2023-11-24T07:56:49.992493+0000","last_peered":"2023-11-24T07:56:49.992493+0000","last_clean":"2023-11-24T07:56:49.992493+0000","last_became_active":"2023-11-24T07:56:49.982720+0000","last_became_peered":"2023-11-24T07:56:49.982720+0000","last_unstale":"2023-11-24T07:56:49.992493+0000","last_undegraded":"2023-11-24T07:56:49.992493+0000","last_fullsized":"2023-11-24T07:56:49.992493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.980964+0000","last_change":"2023-11-24T07:56:48.993105+0000","last_active":"2023-11-24T07:56:49.980964+0000","last_peered":"2023-11-24T07:56:49.980964+0000","last_clean":"2023-11-24T07:56:49.980964+0000","last_became_active":"2023-11-24T07:56:48.991445+0000","last_became_peered":"2023-11-24T07:56:48.991445+0000","last_unstale":"2023-11-24T07:56:49.980964+0000","last_undegraded":"2023-11-24T07:56:49.980964+0000","last_fullsized":"2023-11-24T07:56:49.980964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989165+0000","last_change":"2023-11-24T07:56:49.986008+0000","last_active":"2023-11-24T07:56:50.989165+0000","last_peered":"2023-11-24T07:56:50.989165+0000","last_clean":"2023-11-24T07:56:50.989165+0000","last_became_active":"2023-11-24T07:56:49.985648+0000","last_became_peered":"2023-11-24T07:56:49.985648+0000","last_unstale":"2023-11-24T07:56:50.989165+0000","last_undegraded":"2023-11-24T07:56:50.989165+0000","last_fullsized":"2023-11-24T07:56:50.989165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014789+0000","last_change":"2023-11-24T07:56:48.995945+0000","last_active":"2023-11-24T07:56:50.014789+0000","last_peered":"2023-11-24T07:56:50.014789+0000","last_clean":"2023-11-24T07:56:50.014789+0000","last_became_active":"2023-11-24T07:56:48.995477+0000","last_became_peered":"2023-11-24T07:56:48.995477+0000","last_unstale":"2023-11-24T07:56:50.014789+0000","last_undegraded":"2023-11-24T07:56:50.014789+0000","last_fullsized":"2023-11-24T07:56:50.014789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.999159+0000","last_change":"2023-11-24T07:56:49.995099+0000","last_active":"2023-11-24T07:56:49.999159+0000","last_peered":"2023-11-24T07:56:49.999159+0000","last_clean":"2023-11-24T07:56:49.999159+0000","last_became_active":"2023-11-24T07:56:49.994601+0000","last_became_peered":"2023-11-24T07:56:49.994601+0000","last_unstale":"2023-11-24T07:56:49.999159+0000","last_undegraded":"2023-11-24T07:56:49.999159+0000","last_fullsized":"2023-11-24T07:56:49.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987462+0000","last_change":"2023-11-24T07:56:48.988789+0000","last_active":"2023-11-24T07:56:50.987462+0000","last_peered":"2023-11-24T07:56:50.987462+0000","last_clean":"2023-11-24T07:56:50.987462+0000","last_became_active":"2023-11-24T07:56:48.988504+0000","last_became_peered":"2023-11-24T07:56:48.988504+0000","last_unstale":"2023-11-24T07:56:50.987462+0000","last_undegraded":"2023-11-24T07:56:50.987462+0000","last_fullsized":"2023-11-24T07:56:50.987462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986477+0000","last_change":"2023-11-24T07:56:49.988759+0000","last_active":"2023-11-24T07:56:50.986477+0000","last_peered":"2023-11-24T07:56:50.986477+0000","last_clean":"2023-11-24T07:56:50.986477+0000","last_became_active":"2023-11-24T07:56:49.984052+0000","last_became_peered":"2023-11-24T07:56:49.984052+0000","last_unstale":"2023-11-24T07:56:50.986477+0000","last_undegraded":"2023-11-24T07:56:50.986477+0000","last_fullsized":"2023-11-24T07:56:50.986477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.979766+0000","last_change":"2023-11-24T07:56:48.985064+0000","last_active":"2023-11-24T07:56:49.979766+0000","last_peered":"2023-11-24T07:56:49.979766+0000","last_clean":"2023-11-24T07:56:49.979766+0000","last_became_active":"2023-11-24T07:56:48.984182+0000","last_became_peered":"2023-11-24T07:56:48.984182+0000","last_unstale":"2023-11-24T07:56:49.979766+0000","last_undegraded":"2023-11-24T07:56:49.979766+0000","last_fullsized":"2023-11-24T07:56:49.979766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:08.996477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988201+0000","last_change":"2023-11-24T07:56:49.993700+0000","last_active":"2023-11-24T07:56:50.988201+0000","last_peered":"2023-11-24T07:56:50.988201+0000","last_clean":"2023-11-24T07:56:50.988201+0000","last_became_active":"2023-11-24T07:56:49.993441+0000","last_became_peered":"2023-11-24T07:56:49.993441+0000","last_unstale":"2023-11-24T07:56:50.988201+0000","last_undegraded":"2023-11-24T07:56:50.988201+0000","last_fullsized":"2023-11-24T07:56:50.988201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977896+0000","last_change":"2023-11-24T07:56:48.990448+0000","last_active":"2023-11-24T07:56:49.977896+0000","last_peered":"2023-11-24T07:56:49.977896+0000","last_clean":"2023-11-24T07:56:49.977896+0000","last_became_active":"2023-11-24T07:56:48.990125+0000","last_became_peered":"2023-11-24T07:56:48.990125+0000","last_unstale":"2023-11-24T07:56:49.977896+0000","last_undegraded":"2023-11-24T07:56:49.977896+0000","last_fullsized":"2023-11-24T07:56:49.977896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988606+0000","last_change":"2023-11-24T07:56:49.996725+0000","last_active":"2023-11-24T07:56:50.988606+0000","last_peered":"2023-11-24T07:56:50.988606+0000","last_clean":"2023-11-24T07:56:50.988606+0000","last_became_active":"2023-11-24T07:56:49.996362+0000","last_became_peered":"2023-11-24T07:56:49.996362+0000","last_unstale":"2023-11-24T07:56:50.988606+0000","last_undegraded":"2023-11-24T07:56:50.988606+0000","last_fullsized":"2023-11-24T07:56:50.988606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987884+0000","last_change":"2023-11-24T07:56:48.991238+0000","last_active":"2023-11-24T07:56:50.987884+0000","last_peered":"2023-11-24T07:56:50.987884+0000","last_clean":"2023-11-24T07:56:50.987884+0000","last_became_active":"2023-11-24T07:56:48.990808+0000","last_became_peered":"2023-11-24T07:56:48.990808+0000","last_unstale":"2023-11-24T07:56:50.987884+0000","last_undegraded":"2023-11-24T07:56:50.987884+0000","last_fullsized":"2023-11-24T07:56:50.987884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:47.459786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994311+0000","last_change":"2023-11-24T07:56:49.992018+0000","last_active":"2023-11-24T07:56:49.994311+0000","last_peered":"2023-11-24T07:56:49.994311+0000","last_clean":"2023-11-24T07:56:49.994311+0000","last_became_active":"2023-11-24T07:56:49.990675+0000","last_became_peered":"2023-11-24T07:56:49.990675+0000","last_unstale":"2023-11-24T07:56:49.994311+0000","last_undegraded":"2023-11-24T07:56:49.994311+0000","last_fullsized":"2023-11-24T07:56:49.994311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024180+0000","last_change":"2023-11-24T07:56:50.009926+0000","last_active":"2023-11-24T07:56:50.024180+0000","last_peered":"2023-11-24T07:56:50.024180+0000","last_clean":"2023-11-24T07:56:50.024180+0000","last_became_active":"2023-11-24T07:56:50.009644+0000","last_became_peered":"2023-11-24T07:56:50.009644+0000","last_unstale":"2023-11-24T07:56:50.024180+0000","last_undegraded":"2023-11-24T07:56:50.024180+0000","last_fullsized":"2023-11-24T07:56:50.024180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987753+0000","last_change":"2023-11-24T07:56:48.995707+0000","last_active":"2023-11-24T07:56:50.987753+0000","last_peered":"2023-11-24T07:56:50.987753+0000","last_clean":"2023-11-24T07:56:50.987753+0000","last_became_active":"2023-11-24T07:56:48.994686+0000","last_became_peered":"2023-11-24T07:56:48.994686+0000","last_unstale":"2023-11-24T07:56:50.987753+0000","last_undegraded":"2023-11-24T07:56:50.987753+0000","last_fullsized":"2023-11-24T07:56:50.987753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023956+0000","last_change":"2023-11-24T07:56:49.999352+0000","last_active":"2023-11-24T07:56:50.023956+0000","last_peered":"2023-11-24T07:56:50.023956+0000","last_clean":"2023-11-24T07:56:50.023956+0000","last_became_active":"2023-11-24T07:56:49.998790+0000","last_became_peered":"2023-11-24T07:56:49.998790+0000","last_unstale":"2023-11-24T07:56:50.023956+0000","last_undegraded":"2023-11-24T07:56:50.023956+0000","last_fullsized":"2023-11-24T07:56:50.023956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988009+0000","last_change":"2023-11-24T07:56:48.994077+0000","last_active":"2023-11-24T07:56:50.988009+0000","last_peered":"2023-11-24T07:56:50.988009+0000","last_clean":"2023-11-24T07:56:50.988009+0000","last_became_active":"2023-11-24T07:56:48.993737+0000","last_became_peered":"2023-11-24T07:56:48.993737+0000","last_unstale":"2023-11-24T07:56:50.988009+0000","last_undegraded":"2023-11-24T07:56:50.988009+0000","last_fullsized":"2023-11-24T07:56:50.988009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.021123+0000","last_change":"2023-11-24T07:56:50.020056+0000","last_active":"2023-11-24T07:56:50.021123+0000","last_peered":"2023-11-24T07:56:50.021123+0000","last_clean":"2023-11-24T07:56:50.021123+0000","last_became_active":"2023-11-24T07:56:50.019400+0000","last_became_peered":"2023-11-24T07:56:50.019400+0000","last_unstale":"2023-11-24T07:56:50.021123+0000","last_undegraded":"2023-11-24T07:56:50.021123+0000","last_fullsized":"2023-11-24T07:56:50.021123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988991+0000","last_change":"2023-11-24T07:56:48.995621+0000","last_active":"2023-11-24T07:56:50.988991+0000","last_peered":"2023-11-24T07:56:50.988991+0000","last_clean":"2023-11-24T07:56:50.988991+0000","last_became_active":"2023-11-24T07:56:48.995263+0000","last_became_peered":"2023-11-24T07:56:48.995263+0000","last_unstale":"2023-11-24T07:56:50.988991+0000","last_undegraded":"2023-11-24T07:56:50.988991+0000","last_fullsized":"2023-11-24T07:56:50.988991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988856+0000","last_change":"2023-11-24T07:56:49.997265+0000","last_active":"2023-11-24T07:56:50.988856+0000","last_peered":"2023-11-24T07:56:50.988856+0000","last_clean":"2023-11-24T07:56:50.988856+0000","last_became_active":"2023-11-24T07:56:49.996951+0000","last_became_peered":"2023-11-24T07:56:49.996951+0000","last_unstale":"2023-11-24T07:56:50.988856+0000","last_undegraded":"2023-11-24T07:56:50.988856+0000","last_fullsized":"2023-11-24T07:56:50.988856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018899+0000","last_change":"2023-11-24T07:56:48.997262+0000","last_active":"2023-11-24T07:56:50.018899+0000","last_peered":"2023-11-24T07:56:50.018899+0000","last_clean":"2023-11-24T07:56:50.018899+0000","last_became_active":"2023-11-24T07:56:48.996927+0000","last_became_peered":"2023-11-24T07:56:48.996927+0000","last_unstale":"2023-11-24T07:56:50.018899+0000","last_undegraded":"2023-11-24T07:56:50.018899+0000","last_fullsized":"2023-11-24T07:56:50.018899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":188416,"data_stored":63591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":63751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":794624,"data_stored":654597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:56:54.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:56:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 Processor -- start 2023-11-24T07:56:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 -- start start 2023-11-24T07:56:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f50400abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50400ac460 0x7f50400706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5040145060 con 0x7f5040070c20 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5040071fd0 con 0x7f50400ac460 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.287+0000 7f50455c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ac8c0 con 0x7f5040144c80 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5040070c20 0x7f504015eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35880/0 (socket says 172.21.15.5:35880) 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50400ac460 0x7f50400706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503f7fe640 1 -- 172.21.15.5:0/3875414315 learned_addr learned my addr 172.21.15.5:0/3875414315 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503effd640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f50400abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 -- 172.21.15.5:0/3875414315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 msgr2=0x7f50400abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f50400abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 -- 172.21.15.5:0/3875414315 >> v1:172.21.15.5:6789/0 conn(0x7f5040070c20 legacy=0x7f504015eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 -- 172.21.15.5:0/3875414315 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040071450 con 0x7f50400ac460 2023-11-24T07:56:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503e7fc640 1 -- 172.21.15.5:0/3875414315 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230166826 0 0) 0x7f5040145060 con 0x7f5040070c20 2023-11-24T07:56:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f5037fff640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400ac460 0x7f50400706e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50280097c0 tx=0x7f502801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c2c44d5ec1d6e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503e7fc640 1 -- 172.21.15.5:0/3875414315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50280ab650 con 0x7f50400ac460 2023-11-24T07:56:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503e7fc640 1 -- 172.21.15.5:0/3875414315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280ab7b0 con 0x7f50400ac460 2023-11-24T07:56:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.291+0000 7f503e7fc640 1 -- 172.21.15.5:0/3875414315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50280abb40 con 0x7f50400ac460 2023-11-24T07:56:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- 172.21.15.5:0/3875414315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400ac460 msgr2=0x7f50400706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400ac460 0x7f50400706e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50280097c0 tx=0x7f502801c450 comp rx=0 tx=0).stop 2023-11-24T07:56:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- 172.21.15.5:0/3875414315 shutdown_connections 2023-11-24T07:56:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400ac460 0x7f50400706e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- 172.21.15.5:0/3875414315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f50400abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- 172.21.15.5:0/3875414315 >> 172.21.15.5:0/3875414315 conn(0x7f50400b0c40 msgr2=0x7f50400b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- 172.21.15.5:0/3875414315 shutdown_connections 2023-11-24T07:56:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- 172.21.15.5:0/3875414315 wait complete. 2023-11-24T07:56:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 Processor -- start 2023-11-24T07:56:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- start start 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 0x7f504013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f504013c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504013c230 con 0x7f5040070c20 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504013b640 con 0x7f50400ac460 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f50455c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504013b900 con 0x7f5040144c80 2023-11-24T07:56:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56796/0 (socket says 172.21.15.5:56796) 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 -- 172.21.15.5:0/2789699815 learned_addr learned my addr 172.21.15.5:0/2789699815 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f5037fff640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 0x7f504013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503f7fe640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f504013c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 -- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 msgr2=0x7f504013c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f504013c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 -- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 msgr2=0x7f504013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 0x7f504013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f503effd640 1 -- 172.21.15.5:0/2789699815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009420 con 0x7f5040070c20 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.295+0000 7f5037fff640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 0x7f504013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f503effd640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f503000e870 tx=0x7f503000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030009510 con 0x7f5040070c20 2023-11-24T07:56:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503000eec0 con 0x7f5040070c20 2023-11-24T07:56:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000cb40 con 0x7f5040070c20 2023-11-24T07:56:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504013bbe0 con 0x7f5040070c20 2023-11-24T07:56:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504013b330 con 0x7f5040070c20 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50400b1ba0 con 0x7f5040070c20 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f503000cca0 con 0x7f5040070c20 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.299+0000 7f50377fe640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 0x7f5020068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.303+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50300840a0 con 0x7f5040070c20 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.303+0000 7f5037fff640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 0x7f5020068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.303+0000 7f5037fff640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 0x7f5020068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50280af000 tx=0x7f50280a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.307+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5030051480 con 0x7f5040070c20 2023-11-24T07:56:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.459+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f504013ba70 con 0x7f5020066470 2023-11-24T07:56:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.467+0000 7f50377fe640 1 -- 172.21.15.5:0/2789699815 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264594 (secure 0 0 0) 0x7f504013ba70 con 0x7f5020066470 2023-11-24T07:56:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:56:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 msgr2=0x7f5020068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 0x7f5020068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50280af000 tx=0x7f50280a7000 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 msgr2=0x7f504015e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f503000e870 tx=0x7f503000ec70 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 shutdown_connections 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5020066470 0x7f5020068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5040144c80 0x7f504013c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50400ac460 0x7f504013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 --2- 172.21.15.5:0/2789699815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5040070c20 0x7f504015e330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 >> 172.21.15.5:0/2789699815 conn(0x7f50400b0c40 msgr2=0x7f50400aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 shutdown_connections 2023-11-24T07:56:54.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.471+0000 7f50455c1640 1 -- 172.21.15.5:0/2789699815 wait complete. 2023-11-24T07:56:54.493 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-24T07:56:53.236381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235516,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739204,"statfs":{"total":773094113280,"available":772852944896,"internally_reserved":0,"allocated":2777088,"data_stored":1698360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.282638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988313+0000","last_change":"2023-11-24T07:56:50.004858+0000","last_active":"2023-11-24T07:56:50.988313+0000","last_peered":"2023-11-24T07:56:50.988313+0000","last_clean":"2023-11-24T07:56:50.988313+0000","last_became_active":"2023-11-24T07:56:49.993400+0000","last_became_peered":"2023-11-24T07:56:49.993400+0000","last_unstale":"2023-11-24T07:56:50.988313+0000","last_undegraded":"2023-11-24T07:56:50.988313+0000","last_fullsized":"2023-11-24T07:56:50.988313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:57.211418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994714+0000","last_change":"2023-11-24T07:56:49.991230+0000","last_active":"2023-11-24T07:56:49.994714+0000","last_peered":"2023-11-24T07:56:49.994714+0000","last_clean":"2023-11-24T07:56:49.994714+0000","last_became_active":"2023-11-24T07:56:49.990940+0000","last_became_peered":"2023-11-24T07:56:49.990940+0000","last_unstale":"2023-11-24T07:56:49.994714+0000","last_undegraded":"2023-11-24T07:56:49.994714+0000","last_fullsized":"2023-11-24T07:56:49.994714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994497+0000","last_change":"2023-11-24T07:56:49.989286+0000","last_active":"2023-11-24T07:56:49.994497+0000","last_peered":"2023-11-24T07:56:49.994497+0000","last_clean":"2023-11-24T07:56:49.994497+0000","last_became_active":"2023-11-24T07:56:49.988948+0000","last_became_peered":"2023-11-24T07:56:49.988948+0000","last_unstale":"2023-11-24T07:56:49.994497+0000","last_undegraded":"2023-11-24T07:56:49.994497+0000","last_fullsized":"2023-11-24T07:56:49.994497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.020253+0000","last_change":"2023-11-24T07:56:49.994907+0000","last_active":"2023-11-24T07:56:50.020253+0000","last_peered":"2023-11-24T07:56:50.020253+0000","last_clean":"2023-11-24T07:56:50.020253+0000","last_became_active":"2023-11-24T07:56:49.994332+0000","last_became_peered":"2023-11-24T07:56:49.994332+0000","last_unstale":"2023-11-24T07:56:50.020253+0000","last_undegraded":"2023-11-24T07:56:50.020253+0000","last_fullsized":"2023-11-24T07:56:50.020253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987792+0000","last_change":"2023-11-24T07:56:49.998831+0000","last_active":"2023-11-24T07:56:50.987792+0000","last_peered":"2023-11-24T07:56:50.987792+0000","last_clean":"2023-11-24T07:56:50.987792+0000","last_became_active":"2023-11-24T07:56:49.991235+0000","last_became_peered":"2023-11-24T07:56:49.991235+0000","last_unstale":"2023-11-24T07:56:50.987792+0000","last_undegraded":"2023-11-24T07:56:50.987792+0000","last_fullsized":"2023-11-24T07:56:50.987792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024115+0000","last_change":"2023-11-24T07:56:50.008660+0000","last_active":"2023-11-24T07:56:50.024115+0000","last_peered":"2023-11-24T07:56:50.024115+0000","last_clean":"2023-11-24T07:56:50.024115+0000","last_became_active":"2023-11-24T07:56:50.008297+0000","last_became_peered":"2023-11-24T07:56:50.008297+0000","last_unstale":"2023-11-24T07:56:50.024115+0000","last_undegraded":"2023-11-24T07:56:50.024115+0000","last_fullsized":"2023-11-24T07:56:50.024115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987569+0000","last_change":"2023-11-24T07:56:49.999624+0000","last_active":"2023-11-24T07:56:50.987569+0000","last_peered":"2023-11-24T07:56:50.987569+0000","last_clean":"2023-11-24T07:56:50.987569+0000","last_became_active":"2023-11-24T07:56:49.999370+0000","last_became_peered":"2023-11-24T07:56:49.999370+0000","last_unstale":"2023-11-24T07:56:50.987569+0000","last_undegraded":"2023-11-24T07:56:50.987569+0000","last_fullsized":"2023-11-24T07:56:50.987569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988066+0000","last_change":"2023-11-24T07:56:49.999092+0000","last_active":"2023-11-24T07:56:50.988066+0000","last_peered":"2023-11-24T07:56:50.988066+0000","last_clean":"2023-11-24T07:56:50.988066+0000","last_became_active":"2023-11-24T07:56:49.998578+0000","last_became_peered":"2023-11-24T07:56:49.998578+0000","last_unstale":"2023-11-24T07:56:50.988066+0000","last_undegraded":"2023-11-24T07:56:50.988066+0000","last_fullsized":"2023-11-24T07:56:50.988066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988332+0000","last_change":"2023-11-24T07:56:50.016980+0000","last_active":"2023-11-24T07:56:50.988332+0000","last_peered":"2023-11-24T07:56:50.988332+0000","last_clean":"2023-11-24T07:56:50.988332+0000","last_became_active":"2023-11-24T07:56:50.016704+0000","last_became_peered":"2023-11-24T07:56:50.016704+0000","last_unstale":"2023-11-24T07:56:50.988332+0000","last_undegraded":"2023-11-24T07:56:50.988332+0000","last_fullsized":"2023-11-24T07:56:50.988332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:13.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014744+0000","last_change":"2023-11-24T07:56:50.010849+0000","last_active":"2023-11-24T07:56:50.014744+0000","last_peered":"2023-11-24T07:56:50.014744+0000","last_clean":"2023-11-24T07:56:50.014744+0000","last_became_active":"2023-11-24T07:56:50.010479+0000","last_became_peered":"2023-11-24T07:56:50.010479+0000","last_unstale":"2023-11-24T07:56:50.014744+0000","last_undegraded":"2023-11-24T07:56:50.014744+0000","last_fullsized":"2023-11-24T07:56:50.014744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:12.475852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018935+0000","last_change":"2023-11-24T07:56:50.016938+0000","last_active":"2023-11-24T07:56:50.018935+0000","last_peered":"2023-11-24T07:56:50.018935+0000","last_clean":"2023-11-24T07:56:50.018935+0000","last_became_active":"2023-11-24T07:56:50.016537+0000","last_became_peered":"2023-11-24T07:56:50.016537+0000","last_unstale":"2023-11-24T07:56:50.018935+0000","last_undegraded":"2023-11-24T07:56:50.018935+0000","last_fullsized":"2023-11-24T07:56:50.018935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986876+0000","last_change":"2023-11-24T07:56:49.989957+0000","last_active":"2023-11-24T07:56:50.986876+0000","last_peered":"2023-11-24T07:56:50.986876+0000","last_clean":"2023-11-24T07:56:50.986876+0000","last_became_active":"2023-11-24T07:56:49.989604+0000","last_became_peered":"2023-11-24T07:56:49.989604+0000","last_unstale":"2023-11-24T07:56:50.986876+0000","last_undegraded":"2023-11-24T07:56:50.986876+0000","last_fullsized":"2023-11-24T07:56:50.986876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988569+0000","last_change":"2023-11-24T07:56:49.988221+0000","last_active":"2023-11-24T07:56:50.988569+0000","last_peered":"2023-11-24T07:56:50.988569+0000","last_clean":"2023-11-24T07:56:50.988569+0000","last_became_active":"2023-11-24T07:56:49.987909+0000","last_became_peered":"2023-11-24T07:56:49.987909+0000","last_unstale":"2023-11-24T07:56:50.988569+0000","last_undegraded":"2023-11-24T07:56:50.988569+0000","last_fullsized":"2023-11-24T07:56:50.988569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994190+0000","last_change":"2023-11-24T07:56:49.987632+0000","last_active":"2023-11-24T07:56:49.994190+0000","last_peered":"2023-11-24T07:56:49.994190+0000","last_clean":"2023-11-24T07:56:49.994190+0000","last_became_active":"2023-11-24T07:56:49.983904+0000","last_became_peered":"2023-11-24T07:56:49.983904+0000","last_unstale":"2023-11-24T07:56:49.994190+0000","last_undegraded":"2023-11-24T07:56:49.994190+0000","last_fullsized":"2023-11-24T07:56:49.994190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:54.518837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995667+0000","last_change":"2023-11-24T07:56:49.993099+0000","last_active":"2023-11-24T07:56:49.995667+0000","last_peered":"2023-11-24T07:56:49.995667+0000","last_clean":"2023-11-24T07:56:49.995667+0000","last_became_active":"2023-11-24T07:56:49.992805+0000","last_became_peered":"2023-11-24T07:56:49.992805+0000","last_unstale":"2023-11-24T07:56:49.995667+0000","last_undegraded":"2023-11-24T07:56:49.995667+0000","last_fullsized":"2023-11-24T07:56:49.995667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023924+0000","last_change":"2023-11-24T07:56:49.996222+0000","last_active":"2023-11-24T07:56:50.023924+0000","last_peered":"2023-11-24T07:56:50.023924+0000","last_clean":"2023-11-24T07:56:50.023924+0000","last_became_active":"2023-11-24T07:56:49.995849+0000","last_became_peered":"2023-11-24T07:56:49.995849+0000","last_unstale":"2023-11-24T07:56:50.023924+0000","last_undegraded":"2023-11-24T07:56:50.023924+0000","last_fullsized":"2023-11-24T07:56:50.023924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024237+0000","last_change":"2023-11-24T07:56:50.016330+0000","last_active":"2023-11-24T07:56:50.024237+0000","last_peered":"2023-11-24T07:56:50.024237+0000","last_clean":"2023-11-24T07:56:50.024237+0000","last_became_active":"2023-11-24T07:56:50.016061+0000","last_became_peered":"2023-11-24T07:56:50.016061+0000","last_unstale":"2023-11-24T07:56:50.024237+0000","last_undegraded":"2023-11-24T07:56:50.024237+0000","last_fullsized":"2023-11-24T07:56:50.024237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:02.354677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.997628+0000","last_change":"2023-11-24T07:56:49.995710+0000","last_active":"2023-11-24T07:56:49.997628+0000","last_peered":"2023-11-24T07:56:49.997628+0000","last_clean":"2023-11-24T07:56:49.997628+0000","last_became_active":"2023-11-24T07:56:49.995395+0000","last_became_peered":"2023-11-24T07:56:49.995395+0000","last_unstale":"2023-11-24T07:56:49.997628+0000","last_undegraded":"2023-11-24T07:56:49.997628+0000","last_fullsized":"2023-11-24T07:56:49.997628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988254+0000","last_change":"2023-11-24T07:56:49.987938+0000","last_active":"2023-11-24T07:56:50.988254+0000","last_peered":"2023-11-24T07:56:50.988254+0000","last_clean":"2023-11-24T07:56:50.988254+0000","last_became_active":"2023-11-24T07:56:49.987515+0000","last_became_peered":"2023-11-24T07:56:49.987515+0000","last_unstale":"2023-11-24T07:56:50.988254+0000","last_undegraded":"2023-11-24T07:56:50.988254+0000","last_fullsized":"2023-11-24T07:56:50.988254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995874+0000","last_change":"2023-11-24T07:56:49.994082+0000","last_active":"2023-11-24T07:56:49.995874+0000","last_peered":"2023-11-24T07:56:49.995874+0000","last_clean":"2023-11-24T07:56:49.995874+0000","last_became_active":"2023-11-24T07:56:49.993509+0000","last_became_peered":"2023-11-24T07:56:49.993509+0000","last_unstale":"2023-11-24T07:56:49.995874+0000","last_undegraded":"2023-11-24T07:56:49.995874+0000","last_fullsized":"2023-11-24T07:56:49.995874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994516+0000","last_change":"2023-11-24T07:56:49.981227+0000","last_active":"2023-11-24T07:56:49.994516+0000","last_peered":"2023-11-24T07:56:49.994516+0000","last_clean":"2023-11-24T07:56:49.994516+0000","last_became_active":"2023-11-24T07:56:49.980964+0000","last_became_peered":"2023-11-24T07:56:49.980964+0000","last_unstale":"2023-11-24T07:56:49.994516+0000","last_undegraded":"2023-11-24T07:56:49.994516+0000","last_fullsized":"2023-11-24T07:56:49.994516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:00.102887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024148+0000","last_change":"2023-11-24T07:56:50.009118+0000","last_active":"2023-11-24T07:56:50.024148+0000","last_peered":"2023-11-24T07:56:50.024148+0000","last_clean":"2023-11-24T07:56:50.024148+0000","last_became_active":"2023-11-24T07:56:50.008914+0000","last_became_peered":"2023-11-24T07:56:50.008914+0000","last_unstale":"2023-11-24T07:56:50.024148+0000","last_undegraded":"2023-11-24T07:56:50.024148+0000","last_fullsized":"2023-11-24T07:56:50.024148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988096+0000","last_change":"2023-11-24T07:56:49.993617+0000","last_active":"2023-11-24T07:56:50.988096+0000","last_peered":"2023-11-24T07:56:50.988096+0000","last_clean":"2023-11-24T07:56:50.988096+0000","last_became_active":"2023-11-24T07:56:49.993342+0000","last_became_peered":"2023-11-24T07:56:49.993342+0000","last_unstale":"2023-11-24T07:56:50.988096+0000","last_undegraded":"2023-11-24T07:56:50.988096+0000","last_fullsized":"2023-11-24T07:56:50.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.008741+0000","last_change":"2023-11-24T07:56:49.987374+0000","last_active":"2023-11-24T07:56:50.008741+0000","last_peered":"2023-11-24T07:56:50.008741+0000","last_clean":"2023-11-24T07:56:50.008741+0000","last_became_active":"2023-11-24T07:56:49.987072+0000","last_became_peered":"2023-11-24T07:56:49.987072+0000","last_unstale":"2023-11-24T07:56:50.008741+0000","last_undegraded":"2023-11-24T07:56:50.008741+0000","last_fullsized":"2023-11-24T07:56:50.008741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989129+0000","last_change":"2023-11-24T07:56:50.007415+0000","last_active":"2023-11-24T07:56:50.989129+0000","last_peered":"2023-11-24T07:56:50.989129+0000","last_clean":"2023-11-24T07:56:50.989129+0000","last_became_active":"2023-11-24T07:56:50.007143+0000","last_became_peered":"2023-11-24T07:56:50.007143+0000","last_unstale":"2023-11-24T07:56:50.989129+0000","last_undegraded":"2023-11-24T07:56:50.989129+0000","last_fullsized":"2023-11-24T07:56:50.989129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994779+0000","last_change":"2023-11-24T07:56:49.992073+0000","last_active":"2023-11-24T07:56:49.994779+0000","last_peered":"2023-11-24T07:56:49.994779+0000","last_clean":"2023-11-24T07:56:49.994779+0000","last_became_active":"2023-11-24T07:56:49.991751+0000","last_became_peered":"2023-11-24T07:56:49.991751+0000","last_unstale":"2023-11-24T07:56:49.994779+0000","last_undegraded":"2023-11-24T07:56:49.994779+0000","last_fullsized":"2023-11-24T07:56:49.994779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.993367+0000","last_change":"2023-11-24T07:56:49.991019+0000","last_active":"2023-11-24T07:56:49.993367+0000","last_peered":"2023-11-24T07:56:49.993367+0000","last_clean":"2023-11-24T07:56:49.993367+0000","last_became_active":"2023-11-24T07:56:49.990710+0000","last_became_peered":"2023-11-24T07:56:49.990710+0000","last_unstale":"2023-11-24T07:56:49.993367+0000","last_undegraded":"2023-11-24T07:56:49.993367+0000","last_fullsized":"2023-11-24T07:56:49.993367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988686+0000","last_change":"2023-11-24T07:56:50.007449+0000","last_active":"2023-11-24T07:56:50.988686+0000","last_peered":"2023-11-24T07:56:50.988686+0000","last_clean":"2023-11-24T07:56:50.988686+0000","last_became_active":"2023-11-24T07:56:50.007205+0000","last_became_peered":"2023-11-24T07:56:50.007205+0000","last_unstale":"2023-11-24T07:56:50.988686+0000","last_undegraded":"2023-11-24T07:56:50.988686+0000","last_fullsized":"2023-11-24T07:56:50.988686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.997211+0000","last_change":"2023-11-24T07:56:49.991939+0000","last_active":"2023-11-24T07:56:49.997211+0000","last_peered":"2023-11-24T07:56:49.997211+0000","last_clean":"2023-11-24T07:56:49.997211+0000","last_became_active":"2023-11-24T07:56:49.991553+0000","last_became_peered":"2023-11-24T07:56:49.991553+0000","last_unstale":"2023-11-24T07:56:49.997211+0000","last_undegraded":"2023-11-24T07:56:49.997211+0000","last_fullsized":"2023-11-24T07:56:49.997211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:15.591408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023890+0000","last_change":"2023-11-24T07:56:49.996135+0000","last_active":"2023-11-24T07:56:50.023890+0000","last_peered":"2023-11-24T07:56:50.023890+0000","last_clean":"2023-11-24T07:56:50.023890+0000","last_became_active":"2023-11-24T07:56:49.995502+0000","last_became_peered":"2023-11-24T07:56:49.995502+0000","last_unstale":"2023-11-24T07:56:50.023890+0000","last_undegraded":"2023-11-24T07:56:50.023890+0000","last_fullsized":"2023-11-24T07:56:50.023890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000773+0000","last_change":"2023-11-24T07:56:49.999799+0000","last_active":"2023-11-24T07:56:50.000773+0000","last_peered":"2023-11-24T07:56:50.000773+0000","last_clean":"2023-11-24T07:56:50.000773+0000","last_became_active":"2023-11-24T07:56:49.999461+0000","last_became_peered":"2023-11-24T07:56:49.999461+0000","last_unstale":"2023-11-24T07:56:50.000773+0000","last_undegraded":"2023-11-24T07:56:50.000773+0000","last_fullsized":"2023-11-24T07:56:50.000773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014686+0000","last_change":"2023-11-24T07:56:50.006284+0000","last_active":"2023-11-24T07:56:50.014686+0000","last_peered":"2023-11-24T07:56:50.014686+0000","last_clean":"2023-11-24T07:56:50.014686+0000","last_became_active":"2023-11-24T07:56:50.005181+0000","last_became_peered":"2023-11-24T07:56:50.005181+0000","last_unstale":"2023-11-24T07:56:50.014686+0000","last_undegraded":"2023-11-24T07:56:50.014686+0000","last_fullsized":"2023-11-24T07:56:50.014686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986518+0000","last_change":"2023-11-24T07:56:49.982685+0000","last_active":"2023-11-24T07:56:50.986518+0000","last_peered":"2023-11-24T07:56:50.986518+0000","last_clean":"2023-11-24T07:56:50.986518+0000","last_became_active":"2023-11-24T07:56:49.982396+0000","last_became_peered":"2023-11-24T07:56:49.982396+0000","last_unstale":"2023-11-24T07:56:50.986518+0000","last_undegraded":"2023-11-24T07:56:50.986518+0000","last_fullsized":"2023-11-24T07:56:50.986518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988660+0000","last_change":"2023-11-24T07:56:48.997228+0000","last_active":"2023-11-24T07:56:50.988660+0000","last_peered":"2023-11-24T07:56:50.988660+0000","last_clean":"2023-11-24T07:56:50.988660+0000","last_became_active":"2023-11-24T07:56:48.996544+0000","last_became_peered":"2023-11-24T07:56:48.996544+0000","last_unstale":"2023-11-24T07:56:50.988660+0000","last_undegraded":"2023-11-24T07:56:50.988660+0000","last_fullsized":"2023-11-24T07:56:50.988660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.999525+0000","last_change":"2023-11-24T07:56:49.994392+0000","last_active":"2023-11-24T07:56:49.999525+0000","last_peered":"2023-11-24T07:56:49.999525+0000","last_clean":"2023-11-24T07:56:49.999525+0000","last_became_active":"2023-11-24T07:56:49.991942+0000","last_became_peered":"2023-11-24T07:56:49.991942+0000","last_unstale":"2023-11-24T07:56:49.999525+0000","last_undegraded":"2023-11-24T07:56:49.999525+0000","last_fullsized":"2023-11-24T07:56:49.999525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.009368+0000","last_change":"2023-11-24T07:56:48.990750+0000","last_active":"2023-11-24T07:56:50.009368+0000","last_peered":"2023-11-24T07:56:50.009368+0000","last_clean":"2023-11-24T07:56:50.009368+0000","last_became_active":"2023-11-24T07:56:48.990336+0000","last_became_peered":"2023-11-24T07:56:48.990336+0000","last_unstale":"2023-11-24T07:56:50.009368+0000","last_undegraded":"2023-11-24T07:56:50.009368+0000","last_fullsized":"2023-11-24T07:56:50.009368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988186+0000","last_change":"2023-11-24T07:56:48.996558+0000","last_active":"2023-11-24T07:56:50.988186+0000","last_peered":"2023-11-24T07:56:50.988186+0000","last_clean":"2023-11-24T07:56:50.988186+0000","last_became_active":"2023-11-24T07:56:48.996277+0000","last_became_peered":"2023-11-24T07:56:48.996277+0000","last_unstale":"2023-11-24T07:56:50.988186+0000","last_undegraded":"2023-11-24T07:56:50.988186+0000","last_fullsized":"2023-11-24T07:56:50.988186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988149+0000","last_change":"2023-11-24T07:56:49.990169+0000","last_active":"2023-11-24T07:56:50.988149+0000","last_peered":"2023-11-24T07:56:50.988149+0000","last_clean":"2023-11-24T07:56:50.988149+0000","last_became_active":"2023-11-24T07:56:49.989887+0000","last_became_peered":"2023-11-24T07:56:49.989887+0000","last_unstale":"2023-11-24T07:56:50.988149+0000","last_undegraded":"2023-11-24T07:56:50.988149+0000","last_fullsized":"2023-11-24T07:56:50.988149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.988241+0000","last_change":"2023-11-24T07:56:48.988849+0000","last_active":"2023-11-24T07:56:49.988241+0000","last_peered":"2023-11-24T07:56:49.988241+0000","last_clean":"2023-11-24T07:56:49.988241+0000","last_became_active":"2023-11-24T07:56:48.988481+0000","last_became_peered":"2023-11-24T07:56:48.988481+0000","last_unstale":"2023-11-24T07:56:49.988241+0000","last_undegraded":"2023-11-24T07:56:49.988241+0000","last_fullsized":"2023-11-24T07:56:49.988241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000912+0000","last_change":"2023-11-24T07:56:49.998134+0000","last_active":"2023-11-24T07:56:50.000912+0000","last_peered":"2023-11-24T07:56:50.000912+0000","last_clean":"2023-11-24T07:56:50.000912+0000","last_became_active":"2023-11-24T07:56:49.997733+0000","last_became_peered":"2023-11-24T07:56:49.997733+0000","last_unstale":"2023-11-24T07:56:50.000912+0000","last_undegraded":"2023-11-24T07:56:50.000912+0000","last_fullsized":"2023-11-24T07:56:50.000912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.979666+0000","last_change":"2023-11-24T07:56:48.996333+0000","last_active":"2023-11-24T07:56:49.979666+0000","last_peered":"2023-11-24T07:56:49.979666+0000","last_clean":"2023-11-24T07:56:49.979666+0000","last_became_active":"2023-11-24T07:56:48.995991+0000","last_became_peered":"2023-11-24T07:56:48.995991+0000","last_unstale":"2023-11-24T07:56:49.979666+0000","last_undegraded":"2023-11-24T07:56:49.979666+0000","last_fullsized":"2023-11-24T07:56:49.979666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024210+0000","last_change":"2023-11-24T07:56:50.009044+0000","last_active":"2023-11-24T07:56:50.024210+0000","last_peered":"2023-11-24T07:56:50.024210+0000","last_clean":"2023-11-24T07:56:50.024210+0000","last_became_active":"2023-11-24T07:56:50.008572+0000","last_became_peered":"2023-11-24T07:56:50.008572+0000","last_unstale":"2023-11-24T07:56:50.024210+0000","last_undegraded":"2023-11-24T07:56:50.024210+0000","last_fullsized":"2023-11-24T07:56:50.024210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:09.056215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995837+0000","last_change":"2023-11-24T07:56:48.994794+0000","last_active":"2023-11-24T07:56:49.995837+0000","last_peered":"2023-11-24T07:56:49.995837+0000","last_clean":"2023-11-24T07:56:49.995837+0000","last_became_active":"2023-11-24T07:56:48.994353+0000","last_became_peered":"2023-11-24T07:56:48.994353+0000","last_unstale":"2023-11-24T07:56:49.995837+0000","last_undegraded":"2023-11-24T07:56:49.995837+0000","last_fullsized":"2023-11-24T07:56:49.995837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.000614+0000","last_change":"2023-11-24T07:56:49.999054+0000","last_active":"2023-11-24T07:56:50.000614+0000","last_peered":"2023-11-24T07:56:50.000614+0000","last_clean":"2023-11-24T07:56:50.000614+0000","last_became_active":"2023-11-24T07:56:49.998590+0000","last_became_peered":"2023-11-24T07:56:49.998590+0000","last_unstale":"2023-11-24T07:56:50.000614+0000","last_undegraded":"2023-11-24T07:56:50.000614+0000","last_fullsized":"2023-11-24T07:56:50.000614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.026997+0000","last_change":"2023-11-24T07:56:49.000118+0000","last_active":"2023-11-24T07:56:50.026997+0000","last_peered":"2023-11-24T07:56:50.026997+0000","last_clean":"2023-11-24T07:56:50.026997+0000","last_became_active":"2023-11-24T07:56:48.999794+0000","last_became_peered":"2023-11-24T07:56:48.999794+0000","last_unstale":"2023-11-24T07:56:50.026997+0000","last_undegraded":"2023-11-24T07:56:50.026997+0000","last_fullsized":"2023-11-24T07:56:50.026997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986815+0000","last_change":"2023-11-24T07:56:49.989959+0000","last_active":"2023-11-24T07:56:50.986815+0000","last_peered":"2023-11-24T07:56:50.986815+0000","last_clean":"2023-11-24T07:56:50.986815+0000","last_became_active":"2023-11-24T07:56:49.989687+0000","last_became_peered":"2023-11-24T07:56:49.989687+0000","last_unstale":"2023-11-24T07:56:50.986815+0000","last_undegraded":"2023-11-24T07:56:50.986815+0000","last_fullsized":"2023-11-24T07:56:50.986815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018918+0000","last_change":"2023-11-24T07:56:48.988881+0000","last_active":"2023-11-24T07:56:50.018918+0000","last_peered":"2023-11-24T07:56:50.018918+0000","last_clean":"2023-11-24T07:56:50.018918+0000","last_became_active":"2023-11-24T07:56:48.988590+0000","last_became_peered":"2023-11-24T07:56:48.988590+0000","last_unstale":"2023-11-24T07:56:50.018918+0000","last_undegraded":"2023-11-24T07:56:50.018918+0000","last_fullsized":"2023-11-24T07:56:50.018918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987903+0000","last_change":"2023-11-24T07:56:49.985992+0000","last_active":"2023-11-24T07:56:50.987903+0000","last_peered":"2023-11-24T07:56:50.987903+0000","last_clean":"2023-11-24T07:56:50.987903+0000","last_became_active":"2023-11-24T07:56:49.985719+0000","last_became_peered":"2023-11-24T07:56:49.985719+0000","last_unstale":"2023-11-24T07:56:50.987903+0000","last_undegraded":"2023-11-24T07:56:50.987903+0000","last_fullsized":"2023-11-24T07:56:50.987903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.017899+0000","last_change":"2023-11-24T07:56:48.986496+0000","last_active":"2023-11-24T07:56:50.017899+0000","last_peered":"2023-11-24T07:56:50.017899+0000","last_clean":"2023-11-24T07:56:50.017899+0000","last_became_active":"2023-11-24T07:56:48.986172+0000","last_became_peered":"2023-11-24T07:56:48.986172+0000","last_unstale":"2023-11-24T07:56:50.017899+0000","last_undegraded":"2023-11-24T07:56:50.017899+0000","last_fullsized":"2023-11-24T07:56:50.017899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.992302+0000","last_change":"2023-11-24T07:56:49.979739+0000","last_active":"2023-11-24T07:56:49.992302+0000","last_peered":"2023-11-24T07:56:49.992302+0000","last_clean":"2023-11-24T07:56:49.992302+0000","last_became_active":"2023-11-24T07:56:49.979473+0000","last_became_peered":"2023-11-24T07:56:49.979473+0000","last_unstale":"2023-11-24T07:56:49.992302+0000","last_undegraded":"2023-11-24T07:56:49.992302+0000","last_fullsized":"2023-11-24T07:56:49.992302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.996019+0000","last_change":"2023-11-24T07:56:48.989819+0000","last_active":"2023-11-24T07:56:49.996019+0000","last_peered":"2023-11-24T07:56:49.996019+0000","last_clean":"2023-11-24T07:56:49.996019+0000","last_became_active":"2023-11-24T07:56:48.989226+0000","last_became_peered":"2023-11-24T07:56:48.989226+0000","last_unstale":"2023-11-24T07:56:49.996019+0000","last_undegraded":"2023-11-24T07:56:49.996019+0000","last_fullsized":"2023-11-24T07:56:49.996019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:44.234559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987828+0000","last_change":"2023-11-24T07:56:49.990806+0000","last_active":"2023-11-24T07:56:50.987828+0000","last_peered":"2023-11-24T07:56:50.987828+0000","last_clean":"2023-11-24T07:56:50.987828+0000","last_became_active":"2023-11-24T07:56:49.990478+0000","last_became_peered":"2023-11-24T07:56:49.990478+0000","last_unstale":"2023-11-24T07:56:50.987828+0000","last_undegraded":"2023-11-24T07:56:50.987828+0000","last_fullsized":"2023-11-24T07:56:50.987828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977982+0000","last_change":"2023-11-24T07:56:48.987232+0000","last_active":"2023-11-24T07:56:49.977982+0000","last_peered":"2023-11-24T07:56:49.977982+0000","last_clean":"2023-11-24T07:56:49.977982+0000","last_became_active":"2023-11-24T07:56:48.986874+0000","last_became_peered":"2023-11-24T07:56:48.986874+0000","last_unstale":"2023-11-24T07:56:49.977982+0000","last_undegraded":"2023-11-24T07:56:49.977982+0000","last_fullsized":"2023-11-24T07:56:49.977982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014669+0000","last_change":"2023-11-24T07:56:50.005621+0000","last_active":"2023-11-24T07:56:50.014669+0000","last_peered":"2023-11-24T07:56:50.014669+0000","last_clean":"2023-11-24T07:56:50.014669+0000","last_became_active":"2023-11-24T07:56:50.004796+0000","last_became_peered":"2023-11-24T07:56:50.004796+0000","last_unstale":"2023-11-24T07:56:50.014669+0000","last_undegraded":"2023-11-24T07:56:50.014669+0000","last_fullsized":"2023-11-24T07:56:50.014669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.016381+0000","last_change":"2023-11-24T07:56:48.982818+0000","last_active":"2023-11-24T07:56:50.016381+0000","last_peered":"2023-11-24T07:56:50.016381+0000","last_clean":"2023-11-24T07:56:50.016381+0000","last_became_active":"2023-11-24T07:56:48.982473+0000","last_became_peered":"2023-11-24T07:56:48.982473+0000","last_unstale":"2023-11-24T07:56:50.016381+0000","last_undegraded":"2023-11-24T07:56:50.016381+0000","last_fullsized":"2023-11-24T07:56:50.016381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:40.373215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987624+0000","last_change":"2023-11-24T07:56:49.990672+0000","last_active":"2023-11-24T07:56:50.987624+0000","last_peered":"2023-11-24T07:56:50.987624+0000","last_clean":"2023-11-24T07:56:50.987624+0000","last_became_active":"2023-11-24T07:56:49.990376+0000","last_became_peered":"2023-11-24T07:56:49.990376+0000","last_unstale":"2023-11-24T07:56:50.987624+0000","last_undegraded":"2023-11-24T07:56:50.987624+0000","last_fullsized":"2023-11-24T07:56:50.987624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986880+0000","last_change":"2023-11-24T07:56:48.988508+0000","last_active":"2023-11-24T07:56:50.986880+0000","last_peered":"2023-11-24T07:56:50.986880+0000","last_clean":"2023-11-24T07:56:50.986880+0000","last_became_active":"2023-11-24T07:56:48.988087+0000","last_became_peered":"2023-11-24T07:56:48.988087+0000","last_unstale":"2023-11-24T07:56:50.986880+0000","last_undegraded":"2023-11-24T07:56:50.986880+0000","last_fullsized":"2023-11-24T07:56:50.986880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:06.606043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987995+0000","last_change":"2023-11-24T07:56:49.990816+0000","last_active":"2023-11-24T07:56:50.987995+0000","last_peered":"2023-11-24T07:56:50.987995+0000","last_clean":"2023-11-24T07:56:50.987995+0000","last_became_active":"2023-11-24T07:56:49.990509+0000","last_became_peered":"2023-11-24T07:56:49.990509+0000","last_unstale":"2023-11-24T07:56:50.987995+0000","last_undegraded":"2023-11-24T07:56:50.987995+0000","last_fullsized":"2023-11-24T07:56:50.987995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014876+0000","last_change":"2023-11-24T07:56:48.992645+0000","last_active":"2023-11-24T07:56:50.014876+0000","last_peered":"2023-11-24T07:56:50.014876+0000","last_clean":"2023-11-24T07:56:50.014876+0000","last_became_active":"2023-11-24T07:56:48.992283+0000","last_became_peered":"2023-11-24T07:56:48.992283+0000","last_unstale":"2023-11-24T07:56:50.014876+0000","last_undegraded":"2023-11-24T07:56:50.014876+0000","last_fullsized":"2023-11-24T07:56:50.014876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:53.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988381+0000","last_change":"2023-11-24T07:56:49.993271+0000","last_active":"2023-11-24T07:56:50.988381+0000","last_peered":"2023-11-24T07:56:50.988381+0000","last_clean":"2023-11-24T07:56:50.988381+0000","last_became_active":"2023-11-24T07:56:49.992353+0000","last_became_peered":"2023-11-24T07:56:49.992353+0000","last_unstale":"2023-11-24T07:56:50.988381+0000","last_undegraded":"2023-11-24T07:56:50.988381+0000","last_fullsized":"2023-11-24T07:56:50.988381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:59.074191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.010201+0000","last_change":"2023-11-24T07:56:48.984821+0000","last_active":"2023-11-24T07:56:50.010201+0000","last_peered":"2023-11-24T07:56:50.010201+0000","last_clean":"2023-11-24T07:56:50.010201+0000","last_became_active":"2023-11-24T07:56:48.984545+0000","last_became_peered":"2023-11-24T07:56:48.984545+0000","last_unstale":"2023-11-24T07:56:50.010201+0000","last_undegraded":"2023-11-24T07:56:50.010201+0000","last_fullsized":"2023-11-24T07:56:50.010201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.020243+0000","last_change":"2023-11-24T07:56:49.994668+0000","last_active":"2023-11-24T07:56:50.020243+0000","last_peered":"2023-11-24T07:56:50.020243+0000","last_clean":"2023-11-24T07:56:50.020243+0000","last_became_active":"2023-11-24T07:56:49.993993+0000","last_became_peered":"2023-11-24T07:56:49.993993+0000","last_unstale":"2023-11-24T07:56:50.020243+0000","last_undegraded":"2023-11-24T07:56:50.020243+0000","last_fullsized":"2023-11-24T07:56:50.020243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:15.591408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.974733+0000","last_change":"2023-11-24T07:56:48.997388+0000","last_active":"2023-11-24T07:56:49.974733+0000","last_peered":"2023-11-24T07:56:49.974733+0000","last_clean":"2023-11-24T07:56:49.974733+0000","last_became_active":"2023-11-24T07:56:48.997143+0000","last_became_peered":"2023-11-24T07:56:48.997143+0000","last_unstale":"2023-11-24T07:56:49.974733+0000","last_undegraded":"2023-11-24T07:56:49.974733+0000","last_fullsized":"2023-11-24T07:56:49.974733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988126+0000","last_change":"2023-11-24T07:56:50.017444+0000","last_active":"2023-11-24T07:56:50.988126+0000","last_peered":"2023-11-24T07:56:50.988126+0000","last_clean":"2023-11-24T07:56:50.988126+0000","last_became_active":"2023-11-24T07:56:50.017218+0000","last_became_peered":"2023-11-24T07:56:50.017218+0000","last_unstale":"2023-11-24T07:56:50.988126+0000","last_undegraded":"2023-11-24T07:56:50.988126+0000","last_fullsized":"2023-11-24T07:56:50.988126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.973044+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:56:49.973044+0000","last_peered":"2023-11-24T07:56:49.973044+0000","last_clean":"2023-11-24T07:56:49.973044+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:56:49.973044+0000","last_undegraded":"2023-11-24T07:56:49.973044+0000","last_fullsized":"2023-11-24T07:56:49.973044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.996018+0000","last_change":"2023-11-24T07:56:48.992283+0000","last_active":"2023-11-24T07:56:49.996018+0000","last_peered":"2023-11-24T07:56:49.996018+0000","last_clean":"2023-11-24T07:56:49.996018+0000","last_became_active":"2023-11-24T07:56:48.991808+0000","last_became_peered":"2023-11-24T07:56:48.991808+0000","last_unstale":"2023-11-24T07:56:49.996018+0000","last_undegraded":"2023-11-24T07:56:49.996018+0000","last_fullsized":"2023-11-24T07:56:49.996018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:24.480996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988271+0000","last_change":"2023-11-24T07:56:50.020101+0000","last_active":"2023-11-24T07:56:50.988271+0000","last_peered":"2023-11-24T07:56:50.988271+0000","last_clean":"2023-11-24T07:56:50.988271+0000","last_became_active":"2023-11-24T07:56:50.019553+0000","last_became_peered":"2023-11-24T07:56:50.019553+0000","last_unstale":"2023-11-24T07:56:50.988271+0000","last_undegraded":"2023-11-24T07:56:50.988271+0000","last_fullsized":"2023-11-24T07:56:50.988271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987627+0000","last_change":"2023-11-24T07:56:48.982233+0000","last_active":"2023-11-24T07:56:50.987627+0000","last_peered":"2023-11-24T07:56:50.987627+0000","last_clean":"2023-11-24T07:56:50.987627+0000","last_became_active":"2023-11-24T07:56:48.981854+0000","last_became_peered":"2023-11-24T07:56:48.981854+0000","last_unstale":"2023-11-24T07:56:50.987627+0000","last_undegraded":"2023-11-24T07:56:50.987627+0000","last_fullsized":"2023-11-24T07:56:50.987627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994297+0000","last_change":"2023-11-24T07:56:49.983532+0000","last_active":"2023-11-24T07:56:49.994297+0000","last_peered":"2023-11-24T07:56:49.994297+0000","last_clean":"2023-11-24T07:56:49.994297+0000","last_became_active":"2023-11-24T07:56:49.983242+0000","last_became_peered":"2023-11-24T07:56:49.983242+0000","last_unstale":"2023-11-24T07:56:49.994297+0000","last_undegraded":"2023-11-24T07:56:49.994297+0000","last_fullsized":"2023-11-24T07:56:49.994297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:44.819411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.974236+0000","last_change":"2023-11-24T07:56:48.992743+0000","last_active":"2023-11-24T07:56:49.974236+0000","last_peered":"2023-11-24T07:56:49.974236+0000","last_clean":"2023-11-24T07:56:49.974236+0000","last_became_active":"2023-11-24T07:56:48.992300+0000","last_became_peered":"2023-11-24T07:56:48.992300+0000","last_unstale":"2023-11-24T07:56:49.974236+0000","last_undegraded":"2023-11-24T07:56:49.974236+0000","last_fullsized":"2023-11-24T07:56:49.974236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.985003+0000","last_change":"2023-11-24T07:56:49.981866+0000","last_active":"2023-11-24T07:56:49.985003+0000","last_peered":"2023-11-24T07:56:49.985003+0000","last_clean":"2023-11-24T07:56:49.985003+0000","last_became_active":"2023-11-24T07:56:49.981342+0000","last_became_peered":"2023-11-24T07:56:49.981342+0000","last_unstale":"2023-11-24T07:56:49.985003+0000","last_undegraded":"2023-11-24T07:56:49.985003+0000","last_fullsized":"2023-11-24T07:56:49.985003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.995950+0000","last_change":"2023-11-24T07:56:48.993830+0000","last_active":"2023-11-24T07:56:49.995950+0000","last_peered":"2023-11-24T07:56:49.995950+0000","last_clean":"2023-11-24T07:56:49.995950+0000","last_became_active":"2023-11-24T07:56:48.991880+0000","last_became_peered":"2023-11-24T07:56:48.991880+0000","last_unstale":"2023-11-24T07:56:49.995950+0000","last_undegraded":"2023-11-24T07:56:49.995950+0000","last_fullsized":"2023-11-24T07:56:49.995950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986711+0000","last_change":"2023-11-24T07:56:50.002741+0000","last_active":"2023-11-24T07:56:50.986711+0000","last_peered":"2023-11-24T07:56:50.986711+0000","last_clean":"2023-11-24T07:56:50.986711+0000","last_became_active":"2023-11-24T07:56:49.994282+0000","last_became_peered":"2023-11-24T07:56:49.994282+0000","last_unstale":"2023-11-24T07:56:50.986711+0000","last_undegraded":"2023-11-24T07:56:50.986711+0000","last_fullsized":"2023-11-24T07:56:50.986711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977339+0000","last_change":"2023-11-24T07:56:48.988654+0000","last_active":"2023-11-24T07:56:49.977339+0000","last_peered":"2023-11-24T07:56:49.977339+0000","last_clean":"2023-11-24T07:56:49.977339+0000","last_became_active":"2023-11-24T07:56:48.988250+0000","last_became_peered":"2023-11-24T07:56:48.988250+0000","last_unstale":"2023-11-24T07:56:49.977339+0000","last_undegraded":"2023-11-24T07:56:49.977339+0000","last_fullsized":"2023-11-24T07:56:49.977339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024027+0000","last_change":"2023-11-24T07:56:50.001254+0000","last_active":"2023-11-24T07:56:50.024027+0000","last_peered":"2023-11-24T07:56:50.024027+0000","last_clean":"2023-11-24T07:56:50.024027+0000","last_became_active":"2023-11-24T07:56:49.996268+0000","last_became_peered":"2023-11-24T07:56:49.996268+0000","last_unstale":"2023-11-24T07:56:50.024027+0000","last_undegraded":"2023-11-24T07:56:50.024027+0000","last_fullsized":"2023-11-24T07:56:50.024027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:48.183813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988286+0000","last_change":"2023-11-24T07:56:48.991678+0000","last_active":"2023-11-24T07:56:50.988286+0000","last_peered":"2023-11-24T07:56:50.988286+0000","last_clean":"2023-11-24T07:56:50.988286+0000","last_became_active":"2023-11-24T07:56:48.991306+0000","last_became_peered":"2023-11-24T07:56:48.991306+0000","last_unstale":"2023-11-24T07:56:50.988286+0000","last_undegraded":"2023-11-24T07:56:50.988286+0000","last_fullsized":"2023-11-24T07:56:50.988286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.992493+0000","last_change":"2023-11-24T07:56:49.983208+0000","last_active":"2023-11-24T07:56:49.992493+0000","last_peered":"2023-11-24T07:56:49.992493+0000","last_clean":"2023-11-24T07:56:49.992493+0000","last_became_active":"2023-11-24T07:56:49.982720+0000","last_became_peered":"2023-11-24T07:56:49.982720+0000","last_unstale":"2023-11-24T07:56:49.992493+0000","last_undegraded":"2023-11-24T07:56:49.992493+0000","last_fullsized":"2023-11-24T07:56:49.992493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.980964+0000","last_change":"2023-11-24T07:56:48.993105+0000","last_active":"2023-11-24T07:56:49.980964+0000","last_peered":"2023-11-24T07:56:49.980964+0000","last_clean":"2023-11-24T07:56:49.980964+0000","last_became_active":"2023-11-24T07:56:48.991445+0000","last_became_peered":"2023-11-24T07:56:48.991445+0000","last_unstale":"2023-11-24T07:56:49.980964+0000","last_undegraded":"2023-11-24T07:56:49.980964+0000","last_fullsized":"2023-11-24T07:56:49.980964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989165+0000","last_change":"2023-11-24T07:56:49.986008+0000","last_active":"2023-11-24T07:56:50.989165+0000","last_peered":"2023-11-24T07:56:50.989165+0000","last_clean":"2023-11-24T07:56:50.989165+0000","last_became_active":"2023-11-24T07:56:49.985648+0000","last_became_peered":"2023-11-24T07:56:49.985648+0000","last_unstale":"2023-11-24T07:56:50.989165+0000","last_undegraded":"2023-11-24T07:56:50.989165+0000","last_fullsized":"2023-11-24T07:56:50.989165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.014789+0000","last_change":"2023-11-24T07:56:48.995945+0000","last_active":"2023-11-24T07:56:50.014789+0000","last_peered":"2023-11-24T07:56:50.014789+0000","last_clean":"2023-11-24T07:56:50.014789+0000","last_became_active":"2023-11-24T07:56:48.995477+0000","last_became_peered":"2023-11-24T07:56:48.995477+0000","last_unstale":"2023-11-24T07:56:50.014789+0000","last_undegraded":"2023-11-24T07:56:50.014789+0000","last_fullsized":"2023-11-24T07:56:50.014789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.999159+0000","last_change":"2023-11-24T07:56:49.995099+0000","last_active":"2023-11-24T07:56:49.999159+0000","last_peered":"2023-11-24T07:56:49.999159+0000","last_clean":"2023-11-24T07:56:49.999159+0000","last_became_active":"2023-11-24T07:56:49.994601+0000","last_became_peered":"2023-11-24T07:56:49.994601+0000","last_unstale":"2023-11-24T07:56:49.999159+0000","last_undegraded":"2023-11-24T07:56:49.999159+0000","last_fullsized":"2023-11-24T07:56:49.999159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987462+0000","last_change":"2023-11-24T07:56:48.988789+0000","last_active":"2023-11-24T07:56:50.987462+0000","last_peered":"2023-11-24T07:56:50.987462+0000","last_clean":"2023-11-24T07:56:50.987462+0000","last_became_active":"2023-11-24T07:56:48.988504+0000","last_became_peered":"2023-11-24T07:56:48.988504+0000","last_unstale":"2023-11-24T07:56:50.987462+0000","last_undegraded":"2023-11-24T07:56:50.987462+0000","last_fullsized":"2023-11-24T07:56:50.987462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986477+0000","last_change":"2023-11-24T07:56:49.988759+0000","last_active":"2023-11-24T07:56:50.986477+0000","last_peered":"2023-11-24T07:56:50.986477+0000","last_clean":"2023-11-24T07:56:50.986477+0000","last_became_active":"2023-11-24T07:56:49.984052+0000","last_became_peered":"2023-11-24T07:56:49.984052+0000","last_unstale":"2023-11-24T07:56:50.986477+0000","last_undegraded":"2023-11-24T07:56:50.986477+0000","last_fullsized":"2023-11-24T07:56:50.986477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.979766+0000","last_change":"2023-11-24T07:56:48.985064+0000","last_active":"2023-11-24T07:56:49.979766+0000","last_peered":"2023-11-24T07:56:49.979766+0000","last_clean":"2023-11-24T07:56:49.979766+0000","last_became_active":"2023-11-24T07:56:48.984182+0000","last_became_peered":"2023-11-24T07:56:48.984182+0000","last_unstale":"2023-11-24T07:56:49.979766+0000","last_undegraded":"2023-11-24T07:56:49.979766+0000","last_fullsized":"2023-11-24T07:56:49.979766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:08.996477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988201+0000","last_change":"2023-11-24T07:56:49.993700+0000","last_active":"2023-11-24T07:56:50.988201+0000","last_peered":"2023-11-24T07:56:50.988201+0000","last_clean":"2023-11-24T07:56:50.988201+0000","last_became_active":"2023-11-24T07:56:49.993441+0000","last_became_peered":"2023-11-24T07:56:49.993441+0000","last_unstale":"2023-11-24T07:56:50.988201+0000","last_undegraded":"2023-11-24T07:56:50.988201+0000","last_fullsized":"2023-11-24T07:56:50.988201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.977896+0000","last_change":"2023-11-24T07:56:48.990448+0000","last_active":"2023-11-24T07:56:49.977896+0000","last_peered":"2023-11-24T07:56:49.977896+0000","last_clean":"2023-11-24T07:56:49.977896+0000","last_became_active":"2023-11-24T07:56:48.990125+0000","last_became_peered":"2023-11-24T07:56:48.990125+0000","last_unstale":"2023-11-24T07:56:49.977896+0000","last_undegraded":"2023-11-24T07:56:49.977896+0000","last_fullsized":"2023-11-24T07:56:49.977896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988606+0000","last_change":"2023-11-24T07:56:49.996725+0000","last_active":"2023-11-24T07:56:50.988606+0000","last_peered":"2023-11-24T07:56:50.988606+0000","last_clean":"2023-11-24T07:56:50.988606+0000","last_became_active":"2023-11-24T07:56:49.996362+0000","last_became_peered":"2023-11-24T07:56:49.996362+0000","last_unstale":"2023-11-24T07:56:50.988606+0000","last_undegraded":"2023-11-24T07:56:50.988606+0000","last_fullsized":"2023-11-24T07:56:50.988606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987884+0000","last_change":"2023-11-24T07:56:48.991238+0000","last_active":"2023-11-24T07:56:50.987884+0000","last_peered":"2023-11-24T07:56:50.987884+0000","last_clean":"2023-11-24T07:56:50.987884+0000","last_became_active":"2023-11-24T07:56:48.990808+0000","last_became_peered":"2023-11-24T07:56:48.990808+0000","last_unstale":"2023-11-24T07:56:50.987884+0000","last_undegraded":"2023-11-24T07:56:50.987884+0000","last_fullsized":"2023-11-24T07:56:50.987884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:47.459786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.994311+0000","last_change":"2023-11-24T07:56:49.992018+0000","last_active":"2023-11-24T07:56:49.994311+0000","last_peered":"2023-11-24T07:56:49.994311+0000","last_clean":"2023-11-24T07:56:49.994311+0000","last_became_active":"2023-11-24T07:56:49.990675+0000","last_became_peered":"2023-11-24T07:56:49.990675+0000","last_unstale":"2023-11-24T07:56:49.994311+0000","last_undegraded":"2023-11-24T07:56:49.994311+0000","last_fullsized":"2023-11-24T07:56:49.994311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:07.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.024180+0000","last_change":"2023-11-24T07:56:50.009926+0000","last_active":"2023-11-24T07:56:50.024180+0000","last_peered":"2023-11-24T07:56:50.024180+0000","last_clean":"2023-11-24T07:56:50.024180+0000","last_became_active":"2023-11-24T07:56:50.009644+0000","last_became_peered":"2023-11-24T07:56:50.009644+0000","last_unstale":"2023-11-24T07:56:50.024180+0000","last_undegraded":"2023-11-24T07:56:50.024180+0000","last_fullsized":"2023-11-24T07:56:50.024180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987753+0000","last_change":"2023-11-24T07:56:48.995707+0000","last_active":"2023-11-24T07:56:50.987753+0000","last_peered":"2023-11-24T07:56:50.987753+0000","last_clean":"2023-11-24T07:56:50.987753+0000","last_became_active":"2023-11-24T07:56:48.994686+0000","last_became_peered":"2023-11-24T07:56:48.994686+0000","last_unstale":"2023-11-24T07:56:50.987753+0000","last_undegraded":"2023-11-24T07:56:50.987753+0000","last_fullsized":"2023-11-24T07:56:50.987753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.023956+0000","last_change":"2023-11-24T07:56:49.999352+0000","last_active":"2023-11-24T07:56:50.023956+0000","last_peered":"2023-11-24T07:56:50.023956+0000","last_clean":"2023-11-24T07:56:50.023956+0000","last_became_active":"2023-11-24T07:56:49.998790+0000","last_became_peered":"2023-11-24T07:56:49.998790+0000","last_unstale":"2023-11-24T07:56:50.023956+0000","last_undegraded":"2023-11-24T07:56:50.023956+0000","last_fullsized":"2023-11-24T07:56:50.023956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:52.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988009+0000","last_change":"2023-11-24T07:56:48.994077+0000","last_active":"2023-11-24T07:56:50.988009+0000","last_peered":"2023-11-24T07:56:50.988009+0000","last_clean":"2023-11-24T07:56:50.988009+0000","last_became_active":"2023-11-24T07:56:48.993737+0000","last_became_peered":"2023-11-24T07:56:48.993737+0000","last_unstale":"2023-11-24T07:56:50.988009+0000","last_undegraded":"2023-11-24T07:56:50.988009+0000","last_fullsized":"2023-11-24T07:56:50.988009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.021123+0000","last_change":"2023-11-24T07:56:50.020056+0000","last_active":"2023-11-24T07:56:50.021123+0000","last_peered":"2023-11-24T07:56:50.021123+0000","last_clean":"2023-11-24T07:56:50.021123+0000","last_became_active":"2023-11-24T07:56:50.019400+0000","last_became_peered":"2023-11-24T07:56:50.019400+0000","last_unstale":"2023-11-24T07:56:50.021123+0000","last_undegraded":"2023-11-24T07:56:50.021123+0000","last_fullsized":"2023-11-24T07:56:50.021123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988991+0000","last_change":"2023-11-24T07:56:48.995621+0000","last_active":"2023-11-24T07:56:50.988991+0000","last_peered":"2023-11-24T07:56:50.988991+0000","last_clean":"2023-11-24T07:56:50.988991+0000","last_became_active":"2023-11-24T07:56:48.995263+0000","last_became_peered":"2023-11-24T07:56:48.995263+0000","last_unstale":"2023-11-24T07:56:50.988991+0000","last_undegraded":"2023-11-24T07:56:50.988991+0000","last_fullsized":"2023-11-24T07:56:50.988991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988856+0000","last_change":"2023-11-24T07:56:49.997265+0000","last_active":"2023-11-24T07:56:50.988856+0000","last_peered":"2023-11-24T07:56:50.988856+0000","last_clean":"2023-11-24T07:56:50.988856+0000","last_became_active":"2023-11-24T07:56:49.996951+0000","last_became_peered":"2023-11-24T07:56:49.996951+0000","last_unstale":"2023-11-24T07:56:50.988856+0000","last_undegraded":"2023-11-24T07:56:50.988856+0000","last_fullsized":"2023-11-24T07:56:50.988856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.018899+0000","last_change":"2023-11-24T07:56:48.997262+0000","last_active":"2023-11-24T07:56:50.018899+0000","last_peered":"2023-11-24T07:56:50.018899+0000","last_clean":"2023-11-24T07:56:50.018899+0000","last_became_active":"2023-11-24T07:56:48.996927+0000","last_became_peered":"2023-11-24T07:56:48.996927+0000","last_unstale":"2023-11-24T07:56:50.018899+0000","last_undegraded":"2023-11-24T07:56:50.018899+0000","last_fullsized":"2023-11-24T07:56:50.018899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31364,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340476,"statfs":{"total":96636764160,"available":96604647424,"internally_reserved":0,"allocated":188416,"data_stored":63591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":63751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":794624,"data_stored":654597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:56:54.499 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T07:56:54.500 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T07:56:54.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T07:56:54.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T07:56:54.500 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T07:56:54.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 Processor -- start 2023-11-24T07:56:54.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 -- start start 2023-11-24T07:56:54.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1ac144cf0 0x7fc1ac070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1ac0b44b0 0x7fc1ac0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0ce5b0 con 0x7fc1ac0ce160 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b5d10 con 0x7fc1ac144cf0 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b332a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b4c70 con 0x7fc1ac0b44b0 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b10c6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1ac144cf0 0x7fc1ac070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b18c7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1ac0ce160 0x7fc1ac15eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35894/0 (socket says 172.21.15.5:35894) 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b18c7640 1 -- 172.21.15.5:0/3208381727 learned_addr learned my addr 172.21.15.5:0/3208381727 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b08c5640 1 --2- 172.21.15.5:0/3208381727 >> v2:172.21.15.102:3300/0 conn(0x7fc1ac0b44b0 0x7fc1ac0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.675+0000 7fc1b10c6640 1 -- 172.21.15.5:0/3208381727 >> v2:172.21.15.102:3300/0 conn(0x7fc1ac0b44b0 msgr2=0x7fc1ac0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/3208381727 >> v2:172.21.15.102:3300/0 conn(0x7fc1ac0b44b0 0x7fc1ac0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b10c6640 1 -- 172.21.15.5:0/3208381727 >> v1:172.21.15.5:6789/0 conn(0x7fc1ac0ce160 legacy=0x7fc1ac15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b10c6640 1 -- 172.21.15.5:0/3208381727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0b4f50 con 0x7fc1ac144cf0 2023-11-24T07:56:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1a3fff640 1 -- 172.21.15.5:0/3208381727 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726879010 0 0) 0x7fc1a40014a0 con 0x7fc1ac0ce160 2023-11-24T07:56:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/3208381727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac144cf0 0x7fc1ac070ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0b0c60 tx=0x7fc1a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58f5ae496f69f19 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1a3fff640 1 -- 172.21.15.5:0/3208381727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a7070 con 0x7fc1ac144cf0 2023-11-24T07:56:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1a3fff640 1 -- 172.21.15.5:0/3208381727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80ab430 con 0x7fc1ac144cf0 2023-11-24T07:56:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1a3fff640 1 -- 172.21.15.5:0/3208381727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80ab7c0 con 0x7fc1ac144cf0 2023-11-24T07:56:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 -- 172.21.15.5:0/3208381727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac144cf0 msgr2=0x7fc1ac070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 --2- 172.21.15.5:0/3208381727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac144cf0 0x7fc1ac070ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0b0c60 tx=0x7fc1a801c430 comp rx=0 tx=0).stop 2023-11-24T07:56:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 -- 172.21.15.5:0/3208381727 shutdown_connections 2023-11-24T07:56:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 --2- 172.21.15.5:0/3208381727 >> v2:172.21.15.102:3300/0 conn(0x7fc1ac0b44b0 0x7fc1ac0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 --2- 172.21.15.5:0/3208381727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac144cf0 0x7fc1ac070ae0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 -- 172.21.15.5:0/3208381727 >> 172.21.15.5:0/3208381727 conn(0x7fc1ac0b2ea0 msgr2=0x7fc1ac0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:54.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 -- 172.21.15.5:0/3208381727 shutdown_connections 2023-11-24T07:56:54.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.679+0000 7fc1b332a640 1 -- 172.21.15.5:0/3208381727 wait complete. 2023-11-24T07:56:54.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 Processor -- start 2023-11-24T07:56:54.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 -- start start 2023-11-24T07:56:54.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 0x7fc1ac159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1ac144cf0 0x7fc1ac142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac143170 con 0x7fc1ac0ce160 2023-11-24T07:56:54.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac15c9e0 con 0x7fc1ac0b44b0 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac15d560 con 0x7fc1ac144cf0 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56822/0 (socket says 172.21.15.5:56822) 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 -- 172.21.15.5:0/2717114177 learned_addr learned my addr 172.21.15.5:0/2717114177 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b18c7640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1ac144cf0 0x7fc1ac142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 0x7fc1ac159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 -- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1ac144cf0 msgr2=0x7fc1ac142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1ac144cf0 0x7fc1ac142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 -- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 msgr2=0x7fc1ac159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 0x7fc1ac159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 -- 172.21.15.5:0/2717114177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009420 con 0x7fc1ac0ce160 2023-11-24T07:56:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 0x7fc1ac159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b08c5640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e960 tx=0x7fc19c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c009690 con 0x7fc1ac0ce160 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00ca00 con 0x7fc1ac0ce160 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac0b4a40 con 0x7fc1ac0ce160 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.683+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00cd70 con 0x7fc1ac0ce160 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac15cc30 con 0x7fc1ac0ce160 2023-11-24T07:56:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac04e850 con 0x7fc1ac0ce160 2023-11-24T07:56:54.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc19c013470 con 0x7fc1ac0ce160 2023-11-24T07:56:54.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1a1ffb640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 0x7fc190068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:54.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc19c084070 con 0x7fc1ac0ce160 2023-11-24T07:56:54.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 0x7fc190068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:54.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.687+0000 7fc1b10c6640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 0x7fc190068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80af000 tx=0x7fc1a80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.691+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc19c0b5280 con 0x7fc1ac0ce160 2023-11-24T07:56:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.887+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc1ac0d1f60 con 0x7fc1ac0ce160 2023-11-24T07:56:54.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.887+0000 7fc1a1ffb640 1 -- 172.21.15.5:0/2717114177 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164437 (secure 0 0 0) 0x7fc19c0b3270 con 0x7fc1ac0ce160 2023-11-24T07:56:54.894 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:54.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 msgr2=0x7fc190068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 0x7fc190068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80af000 tx=0x7fc1a80b6040 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 msgr2=0x7fc1ac1420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e960 tx=0x7fc19c00ee20 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 shutdown_connections 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc190066470 0x7fc190068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1ac144cf0 0x7fc1ac142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1ac0ce160 0x7fc1ac1420e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 --2- 172.21.15.5:0/2717114177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ac0b44b0 0x7fc1ac159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 >> 172.21.15.5:0/2717114177 conn(0x7fc1ac0b2ea0 msgr2=0x7fc1ac141410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 shutdown_connections 2023-11-24T07:56:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:54.891+0000 7fc1b332a640 1 -- 172.21.15.5:0/2717114177 wait complete. 2023-11-24T07:56:54.914 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2673346826},{"type":"v1","addr":"172.21.15.102:6833","nonce":2673346826}]},"active_addr":"172.21.15.102:6833/2673346826","active_change":"2023-11-24T07:56:29.225198+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2441556026}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":827193269}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3363854956}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":467814728}]}]} 2023-11-24T07:56:54.917 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T07:56:54.917 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T07:56:54.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 Processor -- start 2023-11-24T07:56:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 -- start start 2023-11-24T07:56:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01fc160980 0x7f01fc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f01fc0b2850 0x7f01fc06b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01fc06d4f0 con 0x7f01fc160d60 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc0d2070 con 0x7f01fc160980 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f02008d5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01fc06c150 con 0x7f01fc0b2850 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01fc160980 0x7f01fc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01fc160980 0x7f01fc0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56832/0 (socket says 172.21.15.5:56832) 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 -- 172.21.15.5:0/4158625919 learned_addr learned my addr 172.21.15.5:0/4158625919 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01f3fff640 1 --2- 172.21.15.5:0/4158625919 >> v2:172.21.15.102:3300/0 conn(0x7f01fc0b2850 0x7f01fc06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 -- 172.21.15.5:0/4158625919 >> v2:172.21.15.102:3300/0 conn(0x7f01fc0b2850 msgr2=0x7f01fc06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 --2- 172.21.15.5:0/4158625919 >> v2:172.21.15.102:3300/0 conn(0x7f01fc0b2850 0x7f01fc06b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 -- 172.21.15.5:0/4158625919 >> v1:172.21.15.102:6789/0 conn(0x7f01fc160d60 legacy=0x7f01fc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.059+0000 7f01fad9d640 1 -- 172.21.15.5:0/4158625919 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc06c430 con 0x7f01fc160980 2023-11-24T07:56:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f01fad9d640 1 --2- 172.21.15.5:0/4158625919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc0cdc00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01fc08ca20 tx=0x7f01ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b1acc93cc87b9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f01fa59c640 1 -- 172.21.15.5:0/4158625919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0aa430 con 0x7f01fc160980 2023-11-24T07:56:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f01fa59c640 1 -- 172.21.15.5:0/4158625919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0aa590 con 0x7f01fc160980 2023-11-24T07:56:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f01fa59c640 1 -- 172.21.15.5:0/4158625919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0aa920 con 0x7f01fc160980 2023-11-24T07:56:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- 172.21.15.5:0/4158625919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 msgr2=0x7f01fc0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 --2- 172.21.15.5:0/4158625919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc0cdc00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01fc08ca20 tx=0x7f01ec01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- 172.21.15.5:0/4158625919 shutdown_connections 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 --2- 172.21.15.5:0/4158625919 >> v2:172.21.15.102:3300/0 conn(0x7f01fc0b2850 0x7f01fc06b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 --2- 172.21.15.5:0/4158625919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc0cdc00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- 172.21.15.5:0/4158625919 >> 172.21.15.5:0/4158625919 conn(0x7f01fc09c5c0 msgr2=0x7f01fc0d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- 172.21.15.5:0/4158625919 shutdown_connections 2023-11-24T07:56:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- 172.21.15.5:0/4158625919 wait complete. 2023-11-24T07:56:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 Processor -- start 2023-11-24T07:56:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.063+0000 7f02008d5640 1 -- start start 2023-11-24T07:56:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01fc0b2850 0x7f01fc156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01fc160d60 0x7f01fc0b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc156840 con 0x7f01fc160980 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc1f78a0 con 0x7f01fc0b2850 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc1f6d20 con 0x7f01fc160d60 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56836/0 (socket says 172.21.15.5:56836) 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 -- 172.21.15.5:0/2941555616 learned_addr learned my addr 172.21.15.5:0/2941555616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01fad9d640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01fc0b2850 0x7f01fc156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01fb59e640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01fc160d60 0x7f01fc0b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 -- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01fc160d60 msgr2=0x7f01fc0b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01fc160d60 0x7f01fc0b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 -- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01fc0b2850 msgr2=0x7f01fc156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01fc0b2850 0x7f01fc156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 -- 172.21.15.5:0/2941555616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0094d0 con 0x7f01fc160980 2023-11-24T07:56:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f3fff640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01e4006e90 tx=0x7f01e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400b6c0 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400b840 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01fc1f7000 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400bbf0 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01fc1f75c0 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.067+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc1f7bf0 con 0x7f01fc160980 2023-11-24T07:56:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.071+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01e400bd50 con 0x7f01fc160980 2023-11-24T07:56:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.071+0000 7f01f37fe640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 0x7f01dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.071+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01e4084240 con 0x7f01fc160980 2023-11-24T07:56:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.071+0000 7f01fad9d640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 0x7f01dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.071+0000 7f01fad9d640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 0x7f01dc068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ae000 tx=0x7f01ec0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.075+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01fc1f7bf0 con 0x7f01fc160980 2023-11-24T07:56:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01fc1f7bf0 con 0x7f01fc160980 2023-11-24T07:56:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f01f37fe640 1 -- 172.21.15.5:0/2941555616 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f01fc1f7bf0 con 0x7f01fc160980 2023-11-24T07:56:55.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:55.238 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 msgr2=0x7f01dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 0x7f01dc068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ae000 tx=0x7f01ec0b5040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 msgr2=0x7f01fc15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01e4006e90 tx=0x7f01e400dc60 comp rx=0 tx=0).stop 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 shutdown_connections 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f01dc066470 0x7f01dc068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01fc160d60 0x7f01fc0b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01fc160980 0x7f01fc15d210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 --2- 172.21.15.5:0/2941555616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01fc0b2850 0x7f01fc156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 >> 172.21.15.5:0/2941555616 conn(0x7f01fc09c5c0 msgr2=0x7f01fc0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 shutdown_connections 2023-11-24T07:56:55.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.235+0000 7f02008d5640 1 -- 172.21.15.5:0/2941555616 wait complete. 2023-11-24T07:56:55.260 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T07:56:55.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.399+0000 7f451ce17640 1 Processor -- start 2023-11-24T07:56:55.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.399+0000 7f451ce17640 1 -- start start 2023-11-24T07:56:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451ce17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f451806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451ce17640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451815dba0 con 0x7f4518146c60 2023-11-24T07:56:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451ce17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451806c860 con 0x7f4518070730 2023-11-24T07:56:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451ce17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451806d100 con 0x7f451815f330 2023-11-24T07:56:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4518146c60 0x7f4518070020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35910/0 (socket says 172.21.15.5:35910) 2023-11-24T07:56:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451659c640 1 -- 172.21.15.5:0/579601769 learned_addr learned my addr 172.21.15.5:0/579601769 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f451806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236087329 0 0) 0x7f451815dba0 con 0x7f4518146c60 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003530 con 0x7f4518146c60 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061766966 0 0) 0x7f4504003530 con 0x7f4518146c60 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 msgr2=0x7f451806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f451806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 >> v1:172.21.15.102:6789/0 conn(0x7f4518070730 legacy=0x7f451806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451806cb40 con 0x7f4518146c60 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f45080016a0 con 0x7f4518146c60 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 >> v1:172.21.15.5:6789/0 conn(0x7f4518146c60 legacy=0x7f4518070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45040039b0 0x7f4504003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f45040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4504005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451806d100 con 0x7f4504004d10 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450400ba40 con 0x7f45040039b0 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450400bc00 con 0x7f451815f330 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4504005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f451659c640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45040039b0 0x7f4504003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f450ffff640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f45040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 -- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 msgr2=0x7f45040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451815f330 0x7f45040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 -- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45040039b0 msgr2=0x7f4504003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45040039b0 0x7f4504003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.403+0000 7f4516d9d640 1 -- 172.21.15.5:0/579601769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504003530 con 0x7f4504004d10 2023-11-24T07:56:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f4516d9d640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4504005190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451815f7c0 tx=0x7f451001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed3cdf36ba0ea00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100a5c10 con 0x7f4504004d10 2023-11-24T07:56:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000f040 con 0x7f4504004d10 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f4515d9b640 1 -- 172.21.15.5:0/579601769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100ad440 con 0x7f4504004d10 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- 172.21.15.5:0/579601769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 msgr2=0x7f4504005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 --2- 172.21.15.5:0/579601769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4504005190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451815f7c0 tx=0x7f451001cc00 comp rx=0 tx=0).stop 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f4516d9d640 1 -- 172.21.15.5:0/579601769 reap_dead start 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- 172.21.15.5:0/579601769 shutdown_connections 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- 172.21.15.5:0/579601769 >> 172.21.15.5:0/579601769 conn(0x7f45180b2ea0 msgr2=0x7f45180b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- 172.21.15.5:0/579601769 shutdown_connections 2023-11-24T07:56:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- 172.21.15.5:0/579601769 wait complete. 2023-11-24T07:56:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 Processor -- start 2023-11-24T07:56:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.407+0000 7f451ce17640 1 -- start start 2023-11-24T07:56:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45181e5a60 0x7f45181e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4518159810 0x7f4518159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45181e64e0 con 0x7f4504004d10 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45181e67c0 con 0x7f45181e5a60 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45181e6aa0 con 0x7f4518159810 2023-11-24T07:56:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56852/0 (socket says 172.21.15.5:56852) 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 -- 172.21.15.5:0/3981441134 learned_addr learned my addr 172.21.15.5:0/3981441134 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 -- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4518159810 msgr2=0x7f4518159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4518159810 0x7f4518159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 -- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45181e5a60 msgr2=0x7f45181e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45181e5a60 0x7f45181e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 -- 172.21.15.5:0/3981441134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45181e6d80 con 0x7f4504004d10 2023-11-24T07:56:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451659c640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4508001210 tx=0x7f4508007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508007e80 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800f940 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45181e7060 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800fcd0 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451813cf80 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.411+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45181e72a0 con 0x7f4504004d10 2023-11-24T07:56:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.415+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f450801d460 con 0x7f4504004d10 2023-11-24T07:56:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.415+0000 7f450effd640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 0x7f44f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.415+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4508083fe0 con 0x7f4504004d10 2023-11-24T07:56:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.415+0000 7f450ffff640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 0x7f44f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.415+0000 7f450ffff640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 0x7f44f8068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4500007fd0 tx=0x7f4500009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.419+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45181e72a0 con 0x7f4504004d10 2023-11-24T07:56:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45181e72a0 con 0x7f4504004d10 2023-11-24T07:56:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f450effd640 1 -- 172.21.15.5:0/3981441134 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f45181e72a0 con 0x7f4504004d10 2023-11-24T07:56:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:55.582 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 msgr2=0x7f44f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 0x7f44f8068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4500007fd0 tx=0x7f4500009040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 msgr2=0x7f4518145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4508001210 tx=0x7f4508007720 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 shutdown_connections 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f44f80664a0 0x7f44f8068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4518159810 0x7f4518159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45181e5a60 0x7f45181e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 --2- 172.21.15.5:0/3981441134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4504004d10 0x7f4518145140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 >> 172.21.15.5:0/3981441134 conn(0x7f45180b2ea0 msgr2=0x7f45181601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 shutdown_connections 2023-11-24T07:56:55.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.579+0000 7f451ce17640 1 -- 172.21.15.5:0/3981441134 wait complete. 2023-11-24T07:56:55.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T07:56:55.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T07:56:55.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T07:56:55.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T07:56:55.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T07:56:55.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T07:56:55.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T07:56:55.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T07:56:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.843+0000 7f1349dd0640 1 Processor -- start 2023-11-24T07:56:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.843+0000 7f1349dd0640 1 -- start start 2023-11-24T07:56:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1349dd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13440ae650 0x7f1344167f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1349dd0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1344143ce0 con 0x7f1344143900 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1349dd0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440acda0 con 0x7f13440ac8a0 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1349dd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13440ad080 con 0x7f13440ae650 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1348dce640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1344143900 0x7f1344072290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35916/0 (socket says 172.21.15.5:35916) 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f1348dce640 1 -- 172.21.15.5:0/4132479262 learned_addr learned my addr 172.21.15.5:0/4132479262 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13495cf640 1 --2- 172.21.15.5:0/4132479262 >> v2:172.21.15.102:3300/0 conn(0x7f13440ae650 0x7f1344167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465045395 0 0) 0x7f1344143ce0 con 0x7f1344143900 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f132c003530 con 0x7f1344143900 2023-11-24T07:56:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796930997 0 0) 0x7f13440acda0 con 0x7f13440ac8a0 2023-11-24T07:56:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1344143ce0 con 0x7f13440ac8a0 2023-11-24T07:56:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13495cf640 1 -- 172.21.15.5:0/4132479262 >> v1:172.21.15.102:6789/0 conn(0x7f13440ac8a0 legacy=0x7f13440adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13495cf640 1 -- 172.21.15.5:0/4132479262 >> v1:172.21.15.5:6789/0 conn(0x7f1344143900 legacy=0x7f1344072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7f13495cf640 1 -- 172.21.15.5:0/4132479262 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440ad360 con 0x7f13440ae650 2023-11-24T07:56:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.847+0000 7fe8e7335640 1 Processor -- start 2023-11-24T07:56:55.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e7335640 1 -- start start 2023-11-24T07:56:55.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e7335640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8e00b4040 0x7fe8e00b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e7335640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00b2590 con 0x7fe8e0162190 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e7335640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00b2870 con 0x7fe8e00b3c60 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e7335640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00b2b50 con 0x7fe8e00b4040 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8e00b4040 0x7fe8e00b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8e00b4040 0x7fe8e00b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54760/0 (socket says 172.21.15.5:54760) 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 -- 172.21.15.5:0/1265022160 learned_addr learned my addr 172.21.15.5:0/1265022160 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 -- 172.21.15.5:0/1265022160 >> v1:172.21.15.102:6789/0 conn(0x7fe8e00b3c60 legacy=0x7fe8e00ce5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 -- 172.21.15.5:0/1265022160 >> v1:172.21.15.5:6789/0 conn(0x7fe8e0162190 legacy=0x7fe8e0165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7fe8e48d0640 1 -- 172.21.15.5:0/1265022160 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00b2e30 con 0x7fe8e00b4040 2023-11-24T07:56:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.851+0000 7f13495cf640 1 --2- 172.21.15.5:0/4132479262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ae650 0x7f1344167f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13340097c0 tx=0x7f133401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7875808b72c04ea1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340ab650 con 0x7f13440ae650 2023-11-24T07:56:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13340ab7b0 con 0x7f13440ae650 2023-11-24T07:56:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f13437fe640 1 -- 172.21.15.5:0/4132479262 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340abb40 con 0x7f13440ae650 2023-11-24T07:56:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f6830e06640 1 Processor -- start 2023-11-24T07:56:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f1349dd0640 1 -- 172.21.15.5:0/4132479262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ae650 msgr2=0x7f1344167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f1349dd0640 1 --2- 172.21.15.5:0/4132479262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ae650 0x7f1344167f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13340097c0 tx=0x7f133401c450 comp rx=0 tx=0).stop 2023-11-24T07:56:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7fe8e48d0640 1 --2- 172.21.15.5:0/1265022160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b4040 0x7fe8e00b1fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009870 tx=0x7fe8d001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9dc9ebc7f03136a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f6830e06640 1 -- start start 2023-11-24T07:56:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f1349dd0640 1 -- 172.21.15.5:0/4132479262 shutdown_connections 2023-11-24T07:56:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f1349dd0640 1 --2- 172.21.15.5:0/4132479262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ae650 0x7f1344167f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7f1349dd0640 1 -- 172.21.15.5:0/4132479262 >> 172.21.15.5:0/4132479262 conn(0x7f13440b0c20 msgr2=0x7f13440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7fe8d7fff640 1 -- 172.21.15.5:0/1265022160 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00aa610 con 0x7fe8e00b4040 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7fe8d7fff640 1 -- 172.21.15.5:0/1265022160 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d00a6040 con 0x7fe8e00b4040 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.855+0000 7fe8d7fff640 1 -- 172.21.15.5:0/1265022160 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00aa990 con 0x7fe8e00b4040 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 -- 172.21.15.5:0/1265022160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b4040 msgr2=0x7fe8e00b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 --2- 172.21.15.5:0/1265022160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b4040 0x7fe8e00b1fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009870 tx=0x7fe8d001c490 comp rx=0 tx=0).stop 2023-11-24T07:56:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f1349dd0640 1 -- 172.21.15.5:0/4132479262 shutdown_connections 2023-11-24T07:56:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f1349dd0640 1 -- 172.21.15.5:0/4132479262 wait complete. 2023-11-24T07:56:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 -- 172.21.15.5:0/1265022160 shutdown_connections 2023-11-24T07:56:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 --2- 172.21.15.5:0/1265022160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b4040 0x7fe8e00b1fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 -- 172.21.15.5:0/1265022160 >> 172.21.15.5:0/1265022160 conn(0x7fe8e00b0cb0 msgr2=0x7fe8e00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6824054390 0x7f682404fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f6824038100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68240532f0 con 0x7f68240e7770 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68240535d0 con 0x7f6824054390 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6830e06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68240538b0 con 0x7f6824037c70 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6829d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6829d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56856/0 (socket says 172.21.15.5:56856) 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6829d9b640 1 -- 172.21.15.5:0/2375033701 learned_addr learned my addr 172.21.15.5:0/2375033701 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f6824038100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 --2- 172.21.15.5:0/2375033701 >> v2:172.21.15.102:3300/0 conn(0x7f6824054390 0x7f682404fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 -- 172.21.15.5:0/1265022160 shutdown_connections 2023-11-24T07:56:55.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7fe8e7335640 1 -- 172.21.15.5:0/1265022160 wait complete. 2023-11-24T07:56:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1349dd0640 1 Processor -- start 2023-11-24T07:56:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1349dd0640 1 -- start start 2023-11-24T07:56:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7fe8e7335640 1 Processor -- start 2023-11-24T07:56:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7fe8e7335640 1 -- start start 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 -- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 msgr2=0x7f6824038100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 --2- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f6824038100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 -- 172.21.15.5:0/2375033701 >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 msgr2=0x7f682404f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 --2- 172.21.15.5:0/2375033701 >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f682b59e640 1 -- 172.21.15.5:0/2375033701 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824053b90 con 0x7f6824054390 2023-11-24T07:56:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.859+0000 7f6829d9b640 1 --2- 172.21.15.5:0/2375033701 >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1349dd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 0x7f134415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f682b59e640 1 --2- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f682404fa10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f682c064230 tx=0x7f682c0968a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e99e679996e74e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1349dd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13440ae650 0x7f1344142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7fe8e7335640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 0x7fe8e009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1349dd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1344143900 0x7f1344142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.863+0000 7f1348dce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 0x7f134415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 0x7f134415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54774/0 (socket says 172.21.15.5:54774) 2023-11-24T07:56:55.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1343fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13440ae650 0x7f1344142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1343fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13440ae650 0x7f1344142150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46426/0 (socket says 172.21.15.5:46426) 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 -- 172.21.15.5:0/296606104 learned_addr learned my addr 172.21.15.5:0/296606104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e7335640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e0162190 0x7fe8e015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 0x7fe8e009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 0x7fe8e009c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54786/0 (socket says 172.21.15.5:54786) 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e7335640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e0099a30 0x7fe8e015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 -- 172.21.15.5:0/3973002400 learned_addr learned my addr 172.21.15.5:0/3973002400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e009ae40 con 0x7fe8e0162190 2023-11-24T07:56:55.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e009aa40 con 0x7fe8e00b3c60 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e009a1a0 con 0x7fe8e0099a30 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e58d2640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e0099a30 0x7fe8e015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e48d0640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e0162190 0x7fe8e015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f682959a640 1 -- 172.21.15.5:0/2375033701 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c120740 con 0x7f6824054390 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 -- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e0099a30 msgr2=0x7fe8e015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e0099a30 0x7fe8e015a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 -- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e0162190 msgr2=0x7fe8e015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e0162190 0x7fe8e015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00094d0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e58d2640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e0099a30 0x7fe8e015a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 Processor -- start 2023-11-24T07:56:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 -- start start 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f682959a640 1 -- 172.21.15.5:0/2375033701 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c1208a0 con 0x7f6824054390 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f682959a640 1 -- 172.21.15.5:0/2375033701 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c120cd0 con 0x7f6824054390 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134415c950 con 0x7f1344143900 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344143ec0 con 0x7f13440ac8a0 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13441441a0 con 0x7f13440ae650 2023-11-24T07:56:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f280e6c10 0x7f4f280e7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2803bef0 con 0x7f4f280061f0 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f28057580 con 0x7f4f280e6c10 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f35548640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280e7570 con 0x7f4f280e2fe0 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f13495cf640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1344143900 0x7f1344142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f34d47640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4f280061f0 0x7f4f28006680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35926/0 (socket says 172.21.15.5:35926) 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f34d47640 1 -- 172.21.15.5:0/3059920165 learned_addr learned my addr 172.21.15.5:0/3059920165 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 -- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 msgr2=0x7f682404fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 --2- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f682404fa10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f682c064230 tx=0x7f682c0968a0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 -- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13440ae650 msgr2=0x7f1344142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13440ae650 0x7f1344142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 -- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1344143900 msgr2=0x7f1344142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1344143900 0x7f1344142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334009420 con 0x7f13440ac8a0 2023-11-24T07:56:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f1348dce640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 0x7f134415c410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f133c00cbc0 tx=0x7f133c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8e50d1640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 0x7fe8e009c4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b4d0 tx=0x7fe8dc00b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/3059920165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2f7fe640 1 --2- 172.21.15.5:0/3059920165 >> v2:172.21.15.5:3300/0 conn(0x7f4f280e6c10 0x7f4f280e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2effd640 1 -- 172.21.15.5:0/3059920165 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520057761 0 0) 0x7f4f2803bef0 con 0x7f4f280061f0 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2effd640 1 -- 172.21.15.5:0/3059920165 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20003530 con 0x7f4f280061f0 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 -- 172.21.15.5:0/2375033701 shutdown_connections 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 --2- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f6824038100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 --2- 172.21.15.5:0/2375033701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f682404fa10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 --2- 172.21.15.5:0/2375033701 >> v2:172.21.15.5:3300/0 conn(0x7f68240e7770 0x7f682404f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 -- 172.21.15.5:0/2375033701 >> 172.21.15.5:0/2375033701 conn(0x7f6824054c70 msgr2=0x7f6824055050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 -- 172.21.15.5:0/2375033701 shutdown_connections 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f6830e06640 1 -- 172.21.15.5:0/2375033701 wait complete. 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2ffff640 1 -- 172.21.15.5:0/3059920165 >> v2:172.21.15.5:3300/0 conn(0x7f4f280e6c10 msgr2=0x7f4f280e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/3059920165 >> v2:172.21.15.5:3300/0 conn(0x7f4f280e6c10 0x7f4f280e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f4f2ffff640 1 -- 172.21.15.5:0/3059920165 >> v1:172.21.15.5:6789/0 conn(0x7f4f280061f0 legacy=0x7f4f28006680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f4f2ffff640 1 -- 172.21.15.5:0/3059920165 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28056f50 con 0x7f4f280e2fe0 2023-11-24T07:56:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00ad40 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1344144480 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1344144a40 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c012400 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00ad40 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1324000fd0 con 0x7f13440ac8a0 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.867+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc010870 con 0x7fe8e00b3c60 2023-11-24T07:56:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0109f0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc010da0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e009a480 con 0x7fe8e00b3c60 2023-11-24T07:56:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e0099ec0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f6830e06640 1 Processor -- start 2023-11-24T07:56:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f13aade7640 1 Processor -- start 2023-11-24T07:56:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8e01618b0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f9eccb6f640 1 Processor -- start 2023-11-24T07:56:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f6830e06640 1 -- start start 2023-11-24T07:56:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.871+0000 7f13aade7640 1 -- start start 2023-11-24T07:56:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9eccb6f640 1 -- start start 2023-11-24T07:56:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 Processor -- start 2023-11-24T07:56:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8dc00f3c0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13aade7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f682404b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f68240487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68240e7770 0x7f68240c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824048ce0 con 0x7f68240e7770 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682404cdc0 con 0x7f6824054390 2023-11-24T07:56:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6830e06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682404d0a0 con 0x7f6824037c70 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9eccb6f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ec0009620 0x7f9ec0055630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 -- start start 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f133c007070 con 0x7f13440ac8a0 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13417fa640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1330066560 0x7f1330068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f133c084190 con 0x7f13440ac8a0 2023-11-24T07:56:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f1343fff640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1330066560 0x7f1330068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6829d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f682404b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f6829d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f682404b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13aade7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13a40d08d0 0x7f13a40b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13aade7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a415d8d0 con 0x7f13a415d4f0 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13aade7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a406c640 con 0x7f13a40d08d0 2023-11-24T07:56:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13aade7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40d1d00 con 0x7f13a40d2da0 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46456/0 (socket says 172.21.15.5:46456) 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 -- 172.21.15.5:0/2201679837 learned_addr learned my addr 172.21.15.5:0/2201679837 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9eccb6f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0052a40 con 0x7f9ec00e7720 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9eccb6f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0051e30 con 0x7f9ec0051970 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9eccb6f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec0052110 con 0x7f9ec0009620 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ec0009620 0x7f9ec0055630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ec0009620 0x7f9ec0055630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54800/0 (socket says 172.21.15.5:54800) 2023-11-24T07:56:55.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 -- 172.21.15.5:0/1801796850 learned_addr learned my addr 172.21.15.5:0/1801796850 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13417fa640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f133006e700 0x7f1330070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f682b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f68240487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f682b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f68240487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54808/0 (socket says 172.21.15.5:54808) 2023-11-24T07:56:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f682b59e640 1 -- 172.21.15.5:0/1146943913 learned_addr learned my addr 172.21.15.5:0/1146943913 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a9384640 1 --2- 172.21.15.5:0/2201679837 >> v2:172.21.15.102:3300/0 conn(0x7f13a40d08d0 0x7f13a40b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 -- 172.21.15.5:0/2201679837 >> v2:172.21.15.102:3300/0 conn(0x7f13a40d08d0 msgr2=0x7f13a40b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 --2- 172.21.15.5:0/2201679837 >> v2:172.21.15.102:3300/0 conn(0x7f13a40d08d0 0x7f13a40b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 -- 172.21.15.5:0/2201679837 >> v1:172.21.15.5:6789/0 conn(0x7f13a415d4f0 legacy=0x7f13a40d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13a3fff640 1 -- 172.21.15.5:0/2201679837 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40d1fe0 con 0x7f13a40d2da0 2023-11-24T07:56:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f480b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480cbd20 con 0x7f4f48072280 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480cc810 con 0x7f4f480b17d0 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f4de6b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48072960 con 0x7f4f480b1fb0 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f477fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f480b17d0 0x7f4f4806df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53294/0 (socket says 172.21.15.5:53294) 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f477fe640 1 -- 172.21.15.5:0/4144878830 learned_addr learned my addr 172.21.15.5:0/4144878830 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f3ffff640 1 --2- 172.21.15.5:0/4144878830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f480b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 -- 172.21.15.5:0/1801796850 >> v1:172.21.15.102:6789/0 conn(0x7f9ec0051970 legacy=0x7f9ec00e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 -- 172.21.15.5:0/1801796850 >> v1:172.21.15.5:6789/0 conn(0x7f9ec00e7720 legacy=0x7f9ec0007c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f9ec77fe640 1 -- 172.21.15.5:0/1801796850 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00523f0 con 0x7f9ec0009620 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13300711d0 con 0x7f133006e700 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f133c00ad40 con 0x7f13440ac8a0 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7fe8d5ffb640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8c4066540 0x7fe8c4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8dc083d50 con 0x7fe8e00b3c60 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8d5ffb640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7fe8c406e6e0 0x7fe8c4070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8c40711b0 con 0x7fe8c406e6e0 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 -- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 msgr2=0x7f68240487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6824054390 0x7f68240487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 -- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68240e7770 msgr2=0x7f68240c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68240e7770 0x7f68240c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c04f7e0 con 0x7f6824037c70 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f4f3ffff640 1 -- 172.21.15.5:0/4144878830 >> v1:172.21.15.102:6789/0 conn(0x7f4f480b17d0 legacy=0x7f4f4806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f4f3ffff640 1 -- 172.21.15.5:0/4144878830 >> v1:172.21.15.5:6789/0 conn(0x7f4f48072280 legacy=0x7f4f480ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8dc0512f0 con 0x7fe8e00b3c60 2023-11-24T07:56:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8e58d2640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7fe8c406e6e0 0x7fe8c4070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6829d9b640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f682404b370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f682000e570 tx=0x7f682000ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f4f46ffd640 1 -- 172.21.15.5:0/4144878830 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194790368 0 0) 0x7f4f480cc810 con 0x7f4f480b17d0 2023-11-24T07:56:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f1343fff640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1330066560 0x7f1330068a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f134406ebf0 tx=0x7f1338009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004230 con 0x7f6824037c70 2023-11-24T07:56:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820004390 con 0x7f6824037c70 2023-11-24T07:56:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820003820 con 0x7f6824037c70 2023-11-24T07:56:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682404d380 con 0x7f6824037c70 2023-11-24T07:56:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f4f3ffff640 1 -- 172.21.15.5:0/4144878830 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480cbf70 con 0x7f4f480b1fb0 2023-11-24T07:56:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8e58d2640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7fe8c406e6e0 0x7fe8c4070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.875+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/3059920165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803e7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f240097c0 tx=0x7f4f2401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943460632478e92e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824048f60 con 0x7f6824037c70 2023-11-24T07:56:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f13495cf640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f133006e700 0x7f1330070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7fe8e48d0640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8c4066540 0x7fe8c4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f682403a140 con 0x7f6824037c70 2023-11-24T07:56:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.879+0000 7f13495cf640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f133006e700 0x7f1330070b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f2effd640 1 -- 172.21.15.5:0/3059920165 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240a8970 con 0x7f4f280e2fe0 2023-11-24T07:56:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f2effd640 1 -- 172.21.15.5:0/3059920165 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f240a8ad0 con 0x7f4f280e2fe0 2023-11-24T07:56:55.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f2effd640 1 -- 172.21.15.5:0/3059920165 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240a8e60 con 0x7f4f280e2fe0 2023-11-24T07:56:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== osd.0 v2:172.21.15.5:6816/2976979729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f13300711d0 con 0x7f133006e700 2023-11-24T07:56:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/1801796850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec0055630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00e71e1a87707a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 -- 172.21.15.5:0/3059920165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 msgr2=0x7f4f2803e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 --2- 172.21.15.5:0/3059920165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803e7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f240097c0 tx=0x7f4f2401ec70 comp rx=0 tx=0).stop 2023-11-24T07:56:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7fe8e48d0640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8c4066540 0x7fe8c4068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00ae000 tx=0x7fe8d00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f3ffff640 1 --2- 172.21.15.5:0/4144878830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f480b37e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f380097f0 tx=0x7f4f3801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753676f0c09d7524 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9ec67fc640 1 -- 172.21.15.5:0/1801796850 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0aa650 con 0x7f9ec0009620 2023-11-24T07:56:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 -- 172.21.15.5:0/3059920165 shutdown_connections 2023-11-24T07:56:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 --2- 172.21.15.5:0/3059920165 >> v2:172.21.15.5:3300/0 conn(0x7f4f280e6c10 0x7f4f280e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 --2- 172.21.15.5:0/3059920165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803e7e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 -- 172.21.15.5:0/3059920165 >> 172.21.15.5:0/3059920165 conn(0x7f4f2803aa20 msgr2=0x7f4f2803ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9ec67fc640 1 -- 172.21.15.5:0/1801796850 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0aa7b0 con 0x7f9ec0009620 2023-11-24T07:56:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9ec67fc640 1 -- 172.21.15.5:0/1801796850 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0aa650 con 0x7f9ec0009620 2023-11-24T07:56:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 -- 172.21.15.5:0/3059920165 shutdown_connections 2023-11-24T07:56:55.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f46ffd640 1 -- 172.21.15.5:0/4144878830 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380ab600 con 0x7f4f480b1fb0 2023-11-24T07:56:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f46ffd640 1 -- 172.21.15.5:0/4144878830 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f380a7050 con 0x7f4f480b1fb0 2023-11-24T07:56:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f46ffd640 1 -- 172.21.15.5:0/4144878830 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380ab980 con 0x7f4f480b1fb0 2023-11-24T07:56:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== osd.1 v2:172.21.15.5:6808/2581618312 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe8c40711b0 con 0x7fe8c406e6e0 2023-11-24T07:56:55.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f35548640 1 -- 172.21.15.5:0/3059920165 wait complete. 2023-11-24T07:56:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6820003980 con 0x7f6824037c70 2023-11-24T07:56:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 -- 172.21.15.5:0/4144878830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 msgr2=0x7f4f480b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 --2- 172.21.15.5:0/4144878830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f480b37e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f380097f0 tx=0x7f4f3801c480 comp rx=0 tx=0).stop 2023-11-24T07:56:55.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 -- 172.21.15.5:0/1801796850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 msgr2=0x7f9ec0055630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 --2- 172.21.15.5:0/1801796850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec0055630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 -- 172.21.15.5:0/4144878830 shutdown_connections 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 --2- 172.21.15.5:0/4144878830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f480b37e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 -- 172.21.15.5:0/4144878830 >> 172.21.15.5:0/4144878830 conn(0x7f4f480b0cb0 msgr2=0x7f4f480b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 -- 172.21.15.5:0/1801796850 shutdown_connections 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 --2- 172.21.15.5:0/1801796850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec0055630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 -- 172.21.15.5:0/1801796850 >> 172.21.15.5:0/1801796850 conn(0x7f9ec0053730 msgr2=0x7f9ec0053b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 -- 172.21.15.5:0/4144878830 shutdown_connections 2023-11-24T07:56:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f4f4de6b640 1 -- 172.21.15.5:0/4144878830 wait complete. 2023-11-24T07:56:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f13a3fff640 1 --2- 172.21.15.5:0/2201679837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a85622f6bcf1a46 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 -- 172.21.15.5:0/1801796850 shutdown_connections 2023-11-24T07:56:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f681affd640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f680c066470 0x7f680c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.883+0000 7f9eccb6f640 1 -- 172.21.15.5:0/1801796850 wait complete. 2023-11-24T07:56:55.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f13a37fe640 1 -- 172.21.15.5:0/2201679837 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980aa620 con 0x7f13a40d2da0 2023-11-24T07:56:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f13a37fe640 1 -- 172.21.15.5:0/2201679837 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980aa780 con 0x7f13a40d2da0 2023-11-24T07:56:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6820083920 con 0x7f6824037c70 2023-11-24T07:56:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f682b59e640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f680c066470 0x7f680c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 Processor -- start 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f681affd640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f680c06e610 0x7f680c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f682b59e640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f680c066470 0x7f680c068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f682c064230 tx=0x7f682c123040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f680c0710e0 con 0x7f680c06e610 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68200882a0 con 0x7f6824037c70 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f13aade7640 1 -- 172.21.15.5:0/2201679837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 msgr2=0x7f13a40d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f13a37fe640 1 -- 172.21.15.5:0/2201679837 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980aa620 con 0x7f13a40d2da0 2023-11-24T07:56:55.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f4de6b640 1 Processor -- start 2023-11-24T07:56:55.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f9eccb6f640 1 Processor -- start 2023-11-24T07:56:55.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f4de6b640 1 -- start start 2023-11-24T07:56:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f682a59c640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f680c06e610 0x7f680c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f9eccb6f640 1 -- start start 2023-11-24T07:56:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f682a59c640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f680c06e610 0x7f680c070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 -- start start 2023-11-24T07:56:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 0x7f4f280d7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f280e6c10 0x7f4f2803d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2817e4c0 con 0x7f4f280e6c10 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2817d880 con 0x7f4f280061f0 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.887+0000 7f4f35548640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2817db20 con 0x7f4f280e2fe0 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 0x7f4f280d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 0x7f4f280d7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54818/0 (socket says 172.21.15.5:54818) 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 -- 172.21.15.5:0/1834478662 learned_addr learned my addr 172.21.15.5:0/1834478662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 --2- 172.21.15.5:0/2201679837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139801c520 comp rx=0 tx=0).stop 2023-11-24T07:56:55.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 -- 172.21.15.5:0/2201679837 shutdown_connections 2023-11-24T07:56:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 --2- 172.21.15.5:0/2201679837 >> v2:172.21.15.102:3300/0 conn(0x7f13a40d08d0 0x7f13a40b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 --2- 172.21.15.5:0/2201679837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a40d2da0 0x7f13a40d1600 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1398009870 tx=0x7f139801c520 comp rx=0 tx=0).stop 2023-11-24T07:56:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 -- 172.21.15.5:0/2201679837 >> 172.21.15.5:0/2201679837 conn(0x7f13a40666a0 msgr2=0x7f13a4066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== osd.3 v2:172.21.15.5:6824/4161007531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f680c0710e0 con 0x7f680c06e610 2023-11-24T07:56:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec00daa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2f7fe640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f34d47640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f280e6c10 0x7f4f2803d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ec0051970 0x7f9ec0031a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f48072280 0x7f4f48150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f480b17d0 0x7f4f48156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f4809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9ec77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec00daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9ec77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec00daa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54824/0 (socket says 172.21.15.5:54824) 2023-11-24T07:56:55.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9ec77fe640 1 -- 172.21.15.5:0/134405449 learned_addr learned my addr 172.21.15.5:0/134405449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 -- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 msgr2=0x7f4f2803d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280e2fe0 0x7f4f2803d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 -- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f280e6c10 msgr2=0x7f4f2803d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f280e6c10 0x7f4f2803d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009420 con 0x7f4f280061f0 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2ffff640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 0x7f4f280d7270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f2401b880 tx=0x7f4f2401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240b0db0 con 0x7f4f280061f0 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f240b9400 con 0x7f4f280061f0 2023-11-24T07:56:55.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2817de00 con 0x7f4f280061f0 2023-11-24T07:56:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240b97b0 con 0x7f4f280061f0 2023-11-24T07:56:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280d77b0 con 0x7f4f280061f0 2023-11-24T07:56:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 -- 172.21.15.5:0/2201679837 shutdown_connections 2023-11-24T07:56:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f13aade7640 1 -- 172.21.15.5:0/2201679837 wait complete. 2023-11-24T07:56:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f13aade7640 1 Processor -- start 2023-11-24T07:56:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec00e7720 0x7f9ec00dbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00e1990 con 0x7f9ec0051970 2023-11-24T07:56:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec004c280 con 0x7f9ec0009620 2023-11-24T07:56:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9eccb6f640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec004c560 con 0x7f9ec00e7720 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec00e7720 0x7f9ec00dbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48099f10 con 0x7f4f480b17d0 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4809a1f0 con 0x7f4f48072280 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f4de6b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4809a4d0 con 0x7f4f480b1fb0 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f4809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f4809afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46490/0 (socket says 172.21.15.5:46490) 2023-11-24T07:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 -- 172.21.15.5:0/3772441105 learned_addr learned my addr 172.21.15.5:0/3772441105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f3ffff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f480b17d0 0x7f4f48156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 -- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f48072280 msgr2=0x7f4f48150b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T07:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f48072280 0x7f4f48150b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 -- 172.21.15.5:0/3772441105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f480b17d0 msgr2=0x7f4f48156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f480b17d0 0x7f4f48156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f4f47fff640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38009420 con 0x7f4f480b1fb0 2023-11-24T07:56:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f28057210 con 0x7f4f280061f0 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.891+0000 7f9ec7fff640 1 -- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 msgr2=0x7f9ec00daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ec0009620 0x7f9ec00daa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9ec7fff640 1 -- 172.21.15.5:0/134405449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ec0051970 msgr2=0x7f9ec0031a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ec0051970 0x7f9ec0031a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9ec7fff640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0094d0 con 0x7f9ec00e7720 2023-11-24T07:56:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f47fff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f4809afb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c780 tx=0x7f4f4000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9ec7fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec00e7720 0x7f9ec00dbd20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0053210 tx=0x7f9eb400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004b70 con 0x7f4f480b1fb0 2023-11-24T07:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f13aade7640 1 -- start start 2023-11-24T07:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000ce90 con 0x7f4f480b1fb0 2023-11-24T07:56:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f4de6b640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4809a7b0 con 0x7f4f480b1fb0 2023-11-24T07:56:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011830 con 0x7f9ec00e7720 2023-11-24T07:56:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4011990 con 0x7f9ec00e7720 2023-11-24T07:56:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011d40 con 0x7f9ec00e7720 2023-11-24T07:56:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000a850 con 0x7f4f480b1fb0 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f13aade7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13a40d08d0 0x7f13a4202880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f13aade7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 0x7f13a4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f13aade7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a414da30 0x7f13a414cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 0x7f13a4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 0x7f13a4157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56938/0 (socket says 172.21.15.5:56938) 2023-11-24T07:56:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a3fff640 1 -- 172.21.15.5:0/2829215185 learned_addr learned my addr 172.21.15.5:0/2829215185 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40c63e0 con 0x7f13a415d4f0 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a414da30 0x7f13a414cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40c57d0 con 0x7f13a40d08d0 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40c5ab0 con 0x7f13a414da30 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 -- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13a40d08d0 msgr2=0x7f13a4202880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13a40d08d0 0x7f13a4202880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 -- 172.21.15.5:0/2829215185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 msgr2=0x7f13a4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 0x7f13a4157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980094d0 con 0x7f13a414da30 2023-11-24T07:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a3fff640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a415d4f0 0x7f13a4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a9384640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a414da30 0x7f13a414cca0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f13a406c320 tx=0x7f139400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9eccb6f640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec004c840 con 0x7f9ec00e7720 2023-11-24T07:56:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.895+0000 7f9eccb6f640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00dafb0 con 0x7f9ec00e7720 2023-11-24T07:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f4de6b640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4809ce70 con 0x7f4f480b1fb0 2023-11-24T07:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f4000a9b0 con 0x7f4f480b1fb0 2023-11-24T07:56:55.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f4de6b640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f481635b0 con 0x7f4f480b1fb0 2023-11-24T07:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f240b7040 con 0x7f4f280061f0 2023-11-24T07:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f14066470 0x7f4f14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f24122100 con 0x7f4f280061f0 2023-11-24T07:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f280664c0 0x7f4f28068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f400835e0 con 0x7f4f480b1fb0 2023-11-24T07:56:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ec00e7b00 con 0x7f9ec00e7720 2023-11-24T07:56:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2f7fe640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f14066470 0x7f4f14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7f4f2806e6e0 0x7f4f28070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f280711b0 con 0x7f4f2806e6e0 2023-11-24T07:56:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f40083960 con 0x7f4f480b1fb0 2023-11-24T07:56:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f4f1406e610 0x7f4f14070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f140710e0 con 0x7f4f1406e610 2023-11-24T07:56:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f24122470 con 0x7f4f280061f0 2023-11-24T07:56:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400ee80 con 0x7f13a414da30 2023-11-24T07:56:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400c910 con 0x7f13a414da30 2023-11-24T07:56:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400ccc0 con 0x7f13a414da30 2023-11-24T07:56:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f477fe640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f280664c0 0x7f4f28068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a40c5d90 con 0x7f13a414da30 2023-11-24T07:56:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a4202dc0 con 0x7f13a414da30 2023-11-24T07:56:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f4f3ffff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7f4f2806e6e0 0x7f4f28070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.899+0000 7f10592bb640 1 Processor -- start 2023-11-24T07:56:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 -- start start 2023-11-24T07:56:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f4f34d47640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f4f1406e610 0x7f4f14070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f4f2f7fe640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f14066470 0x7f4f14068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f280de210 tx=0x7f4f1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13a4074990 con 0x7f13a414da30 2023-11-24T07:56:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9eb401a400 con 0x7f9ec00e7720 2023-11-24T07:56:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f4f3ffff640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7f4f2806e6e0 0x7f4f28070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f10540cda40 0x7f10540b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1054161f50 con 0x7f10541654f0 2023-11-24T07:56:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1054166070 con 0x7f10540cda40 2023-11-24T07:56:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f4f34d47640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f4f1406e610 0x7f4f14070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10592bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1054161d40 con 0x7f10540cde20 2023-11-24T07:56:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== osd.6 v2:172.21.15.102:6809/2249940910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4f280711b0 con 0x7f4f2806e6e0 2023-11-24T07:56:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f1053fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f10540cda40 0x7f10540b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46522/0 (socket says 172.21.15.5:46522) 2023-11-24T07:56:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 -- 172.21.15.5:0/3865151250 learned_addr learned my addr 172.21.15.5:0/3865151250 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f4f477fe640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f280664c0 0x7f4f28068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007fd0 tx=0x7f4f300078c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 -- 172.21.15.5:0/3865151250 >> v2:172.21.15.102:3300/0 conn(0x7f10540cda40 msgr2=0x7f10540b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 --2- 172.21.15.5:0/3865151250 >> v2:172.21.15.102:3300/0 conn(0x7f10540cda40 0x7f10540b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 -- 172.21.15.5:0/3865151250 >> v1:172.21.15.5:6789/0 conn(0x7f10541654f0 legacy=0x7f1054165960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7f10537fe640 1 -- 172.21.15.5:0/3865151250 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054162230 con 0x7f10540cde20 2023-11-24T07:56:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.903+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 --> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8e0066dd0 con 0x7fe8c406e6e0 2023-11-24T07:56:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7fe8d5ffb640 1 -- 172.21.15.5:0/3973002400 <== osd.1 v2:172.21.15.5:6808/2581618312 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8e0066dd0 con 0x7fe8c406e6e0 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9eac0664c0 0x7f9eac068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eb4083d70 con 0x7f9ec00e7720 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7f9eac06e6e0 0x7f9eac070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9eac0711b0 con 0x7f9eac06e6e0 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9eb4086350 con 0x7f9ec00e7720 2023-11-24T07:56:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1394013470 con 0x7f13a414da30 2023-11-24T07:56:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== osd.2 v2:172.21.15.5:6800/3596801206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4f140710e0 con 0x7f4f1406e610 2023-11-24T07:56:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7f9eac06e6e0 0x7f9eac070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9eac0664c0 0x7f9eac068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13900664c0 0x7f1390068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f139400ce20 con 0x7f13a414da30 2023-11-24T07:56:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9ec6ffd640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7f9eac06e6e0 0x7f9eac070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a8b83640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13900664c0 0x7f1390068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7f139006f3c0 0x7f1390071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1390071f30 con 0x7f139006f3c0 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13940551f0 con 0x7f13a414da30 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a3fff640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7f139006f3c0 0x7f1390071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== osd.5 v2:172.21.15.102:6808/2731741621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9eac0711b0 con 0x7f9eac06e6e0 2023-11-24T07:56:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.907+0000 7f13a8b83640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13900664c0 0x7f1390068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f139c00ab90 tx=0x7f139c009230 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.911+0000 7f13a3fff640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7f139006f3c0 0x7f1390071860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.911+0000 7f10537fe640 1 --2- 172.21.15.5:0/3865151250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f104801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af733b7baec2255b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.911+0000 7f9ec77fe640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9eac0664c0 0x7f9eac068980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc01a100 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== osd.4 v2:172.21.15.102:6800/401703187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1390071f30 con 0x7f139006f3c0 2023-11-24T07:56:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f1052ffd640 1 -- 172.21.15.5:0/3865151250 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480ab600 con 0x7f10540cde20 2023-11-24T07:56:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f1052ffd640 1 -- 172.21.15.5:0/3865151250 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10480a7050 con 0x7f10540cde20 2023-11-24T07:56:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f1052ffd640 1 -- 172.21.15.5:0/3865151250 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480ab980 con 0x7f10540cde20 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7fe8c406e6e0 msgr2=0x7fe8c4070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7fe8c406e6e0 0x7fe8c4070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8c4066540 msgr2=0x7fe8c4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8c4066540 0x7fe8c4068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00ae000 tx=0x7fe8d00b5040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 msgr2=0x7fe8e009c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 --2- 172.21.15.5:0/3973002400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e00b3c60 0x7fe8e009c4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b4d0 tx=0x7fe8dc00b990 comp rx=0 tx=0).stop 2023-11-24T07:56:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 --> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1324002cc0 con 0x7f133006e700 2023-11-24T07:56:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e58d2640 1 -- 172.21.15.5:0/3973002400 reap_dead start 2023-11-24T07:56:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 shutdown_connections 2023-11-24T07:56:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 >> 172.21.15.5:0/3973002400 conn(0x7fe8e00b0cb0 msgr2=0x7fe8e015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 shutdown_connections 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 -- 172.21.15.5:0/3865151250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 msgr2=0x7f10540b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 --2- 172.21.15.5:0/3865151250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f104801c560 comp rx=0 tx=0).stop 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 -- 172.21.15.5:0/3865151250 shutdown_connections 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 --2- 172.21.15.5:0/3865151250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b5180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 --2- 172.21.15.5:0/3865151250 >> v2:172.21.15.102:3300/0 conn(0x7f10540cda40 0x7f10540b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 -- 172.21.15.5:0/3865151250 >> 172.21.15.5:0/3865151250 conn(0x7f10540668a0 msgr2=0x7f10540cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7fe8e7335640 1 -- 172.21.15.5:0/3973002400 wait complete. 2023-11-24T07:56:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 -- 172.21.15.5:0/3865151250 shutdown_connections 2023-11-24T07:56:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f13417fa640 1 -- 172.21.15.5:0/296606104 <== osd.0 v2:172.21.15.5:6816/2976979729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1324002cc0 con 0x7f133006e700 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 --> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6824005470 con 0x7f680c06e610 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f681affd640 1 -- 172.21.15.5:0/1146943913 <== osd.3 v2:172.21.15.5:6824/4161007531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6824005470 con 0x7f680c06e610 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.919+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f680c06e610 msgr2=0x7f680c070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.919+0000 7f6830e06640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f680c06e610 0x7f680c070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.915+0000 7f10592bb640 1 -- 172.21.15.5:0/3865151250 wait complete. 2023-11-24T07:56:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.919+0000 7f10592bb640 1 Processor -- start 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.919+0000 7f10592bb640 1 -- start start 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.919+0000 7f10592bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10540cda40 0x7f10540c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f133006e700 msgr2=0x7f1330070b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f133006e700 0x7f1330070b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f680c066470 msgr2=0x7f680c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f680c066470 0x7f680c068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f682c064230 tx=0x7f682c123040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 msgr2=0x7f682404b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1330066560 msgr2=0x7f1330068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1330066560 0x7f1330068a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f134406ebf0 tx=0x7f1338009040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 --2- 172.21.15.5:0/1146943913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6824037c70 0x7f682404b370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f682000e570 tx=0x7f682000ea30 comp rx=0 tx=0).stop 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f682a59c640 1 -- 172.21.15.5:0/1146943913 reap_dead start 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 shutdown_connections 2023-11-24T07:56:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 >> 172.21.15.5:0/1146943913 conn(0x7f6824054c70 msgr2=0x7f682403a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10592bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 msgr2=0x7f134415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 --2- 172.21.15.5:0/296606104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13440ac8a0 0x7f134415c410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f133c00cbc0 tx=0x7f133c00a430 comp rx=0 tx=0).stop 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f13495cf640 1 -- 172.21.15.5:0/296606104 reap_dead start 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 shutdown_connections 2023-11-24T07:56:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 >> 172.21.15.5:0/296606104 conn(0x7f13440b0c20 msgr2=0x7f13440afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10592bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10541654f0 0x7f10540b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10537fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10537fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46528/0 (socket says 172.21.15.5:46528) 2023-11-24T07:56:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 shutdown_connections 2023-11-24T07:56:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f6830e06640 1 -- 172.21.15.5:0/1146943913 wait complete. 2023-11-24T07:56:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 shutdown_connections 2023-11-24T07:56:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1349dd0640 1 -- 172.21.15.5:0/296606104 wait complete. 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10537fe640 1 -- 172.21.15.5:0/2314074215 learned_addr learned my addr 172.21.15.5:0/2314074215 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105415b8e0 con 0x7f10540cda40 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105415bd70 con 0x7f10541654f0 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105415acd0 con 0x7f10540cde20 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10541654f0 0x7f10540b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 -- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 msgr2=0x7f10540b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 -- 172.21.15.5:0/2314074215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10540cda40 msgr2=0x7f10540c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10540cda40 0x7f10540c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480094d0 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f10537fe640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10540cde20 0x7f10540b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1058aba640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10541654f0 0x7f10540b8070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f104400c390 tx=0x7f104400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.923+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10440052d0 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.927+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1044005430 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.927+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044003840 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.927+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105415afb0 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.927+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105415b570 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.927+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1054074990 con 0x7f10541654f0 2023-11-24T07:56:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10440039a0 con 0x7f10541654f0 2023-11-24T07:56:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f4de6b640 1 -- 172.21.15.5:0/3772441105 --> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f4804e850 con 0x7f4f2806e6e0 2023-11-24T07:56:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f44ff9640 1 -- 172.21.15.5:0/3772441105 <== osd.6 v2:172.21.15.102:6809/2249940910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f4804e850 con 0x7f4f2806e6e0 2023-11-24T07:56:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7f4f2806e6e0 msgr2=0x7f4f28070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7f4f2806e6e0 0x7f4f28070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f280664c0 msgr2=0x7f4f28068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f280664c0 0x7f4f28068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007fd0 tx=0x7f4f300078c0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 msgr2=0x7f4f4809afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 --2- 172.21.15.5:0/3772441105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f480b1fb0 0x7f4f4809afb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c780 tx=0x7f4f4000cc40 comp rx=0 tx=0).stop 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f47fff640 1 -- 172.21.15.5:0/3772441105 reap_dead start 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 shutdown_connections 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 >> 172.21.15.5:0/3772441105 conn(0x7f4f480b0cb0 msgr2=0x7f4f4806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1040066540 0x7f1040068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10440832c0 con 0x7f10541654f0 2023-11-24T07:56:55.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f104006e760 0x7f1040070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:55.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 shutdown_connections 2023-11-24T07:56:55.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f4f3dffb640 1 -- 172.21.15.5:0/3772441105 wait complete. 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1040071230 con 0x7f104006e760 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1044085880 con 0x7f10541654f0 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.931+0000 7f1053fff640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1040066540 0x7f1040068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.935+0000 7f10537fe640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f104006e760 0x7f1040070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.935+0000 7f1053fff640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1040066540 0x7f1040068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f104c009fa0 tx=0x7f104c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.935+0000 7f10537fe640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f104006e760 0x7f1040070b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.935+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== osd.7 v2:172.21.15.102:6824/1162611146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1040071230 con 0x7f104006e760 2023-11-24T07:56:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.939+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 --> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f28007a30 con 0x7f4f1406e610 2023-11-24T07:56:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.939+0000 7f4f2cff9640 1 -- 172.21.15.5:0/1834478662 <== osd.2 v2:172.21.15.5:6800/3596801206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f3004ee50 con 0x7f4f1406e610 2023-11-24T07:56:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 --> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ec0008de0 con 0x7f9eac06e6e0 2023-11-24T07:56:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb3fff640 1 -- 172.21.15.5:0/134405449 <== osd.5 v2:172.21.15.102:6808/2731741621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ec804ed70 con 0x7f9eac06e6e0 2023-11-24T07:56:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f4f1406e610 msgr2=0x7f4f14070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 --> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13a406a5b0 con 0x7f139006f3c0 2023-11-24T07:56:55.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f4f1406e610 0x7f4f14070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f14066470 msgr2=0x7f4f14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f14066470 0x7f4f14068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f280de210 tx=0x7f4f1c008040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 msgr2=0x7f4f280d7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 --2- 172.21.15.5:0/1834478662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f280061f0 0x7f4f280d7270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f2401b880 tx=0x7f4f2401ba10 comp rx=0 tx=0).stop 2023-11-24T07:56:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13a17fa640 1 -- 172.21.15.5:0/2829215185 <== osd.4 v2:172.21.15.102:6800/401703187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13a406a5b0 con 0x7f139006f3c0 2023-11-24T07:56:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f34d47640 1 -- 172.21.15.5:0/1834478662 reap_dead start 2023-11-24T07:56:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 shutdown_connections 2023-11-24T07:56:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 >> 172.21.15.5:0/1834478662 conn(0x7f4f2803aa20 msgr2=0x7f4f28038090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7f139006f3c0 msgr2=0x7f1390071860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7f139006f3c0 0x7f1390071860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13900664c0 msgr2=0x7f1390068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 shutdown_connections 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7f9eac06e6e0 msgr2=0x7f9eac070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7f9eac06e6e0 0x7f9eac070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13900664c0 0x7f1390068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f139c00ab90 tx=0x7f139c009230 comp rx=0 tx=0).stop 2023-11-24T07:56:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f4f35548640 1 -- 172.21.15.5:0/1834478662 wait complete. 2023-11-24T07:56:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a414da30 msgr2=0x7f13a414cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13aade7640 1 --2- 172.21.15.5:0/2829215185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13a414da30 0x7f13a414cca0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f13a406c320 tx=0x7f139400ec30 comp rx=0 tx=0).stop 2023-11-24T07:56:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9eac0664c0 msgr2=0x7f9eac068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9eac0664c0 0x7f9eac068980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc01a100 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec00e7720 msgr2=0x7f9ec00dbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f9eb1ffb640 1 --2- 172.21.15.5:0/134405449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec00e7720 0x7f9ec00dbd20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0053210 tx=0x7f9eb400b870 comp rx=0 tx=0).stop 2023-11-24T07:56:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f9ec7fff640 1 -- 172.21.15.5:0/134405449 reap_dead start 2023-11-24T07:56:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.943+0000 7f13a9384640 1 -- 172.21.15.5:0/2829215185 reap_dead start 2023-11-24T07:56:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 shutdown_connections 2023-11-24T07:56:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 >> 172.21.15.5:0/134405449 conn(0x7f9ec0053730 msgr2=0x7f9ec00e63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 shutdown_connections 2023-11-24T07:56:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 >> 172.21.15.5:0/2829215185 conn(0x7f13a40666a0 msgr2=0x7f13a40b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 shutdown_connections 2023-11-24T07:56:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f9eb1ffb640 1 -- 172.21.15.5:0/134405449 wait complete. 2023-11-24T07:56:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 shutdown_connections 2023-11-24T07:56:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:55.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T07:56:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.947+0000 7f13aade7640 1 -- 172.21.15.5:0/2829215185 wait complete. 2023-11-24T07:56:55.976 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:55.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T07:56:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 --> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f105415ba50 con 0x7f104006e760 2023-11-24T07:56:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f1050ff9640 1 -- 172.21.15.5:0/2314074215 <== osd.7 v2:172.21.15.102:6824/1162611146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f105415ba50 con 0x7f104006e760 2023-11-24T07:56:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f104006e760 msgr2=0x7f1040070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f104006e760 0x7f1040070b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1040066540 msgr2=0x7f1040068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1040066540 0x7f1040068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f104c009fa0 tx=0x7f104c00b040 comp rx=0 tx=0).stop 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10541654f0 msgr2=0x7f10540b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 --2- 172.21.15.5:0/2314074215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10541654f0 0x7f10540b8070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f104400c390 tx=0x7f104400c850 comp rx=0 tx=0).stop 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f1058aba640 1 -- 172.21.15.5:0/2314074215 reap_dead start 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 shutdown_connections 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.963+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 >> 172.21.15.5:0/2314074215 conn(0x7f10540668a0 msgr2=0x7f10541609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.967+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 shutdown_connections 2023-11-24T07:56:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:55.967+0000 7f10592bb640 1 -- 172.21.15.5:0/2314074215 wait complete. 2023-11-24T07:56:55.980 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:55.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T07:56:55.981 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:55.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T07:56:55.982 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:55.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T07:56:55.987 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:55.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T07:56:55.990 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:55.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T07:56:56.001 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:56.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T07:56:56.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.191+0000 7fd3c1d2a640 1 Processor -- start 2023-11-24T07:56:56.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.191+0000 7fd3c1d2a640 1 -- start start 2023-11-24T07:56:56.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3c1d2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd3bc1593c0 0x7fd3bc0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3c1d2a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3c1d2a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0cd860 con 0x7fd3bc0cdcf0 2023-11-24T07:56:56.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3c1d2a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b50c0 con 0x7fd3bc1593c0 2023-11-24T07:56:56.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3c1d2a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0ccc90 con 0x7fd3bc070b80 2023-11-24T07:56:56.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3baffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd3bc0cdcf0 0x7fd3bc070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35964/0 (socket says 172.21.15.5:35964) 2023-11-24T07:56:56.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3baffd640 1 -- 172.21.15.5:0/1140522575 learned_addr learned my addr 172.21.15.5:0/1140522575 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:56.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3bbfff640 1 --2- 172.21.15.5:0/1140522575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3bbfff640 1 -- 172.21.15.5:0/1140522575 >> v2:172.21.15.102:3300/0 conn(0x7fd3bc1593c0 msgr2=0x7fd3bc0b48b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T07:56:56.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3bbfff640 1 --2- 172.21.15.5:0/1140522575 >> v2:172.21.15.102:3300/0 conn(0x7fd3bc1593c0 0x7fd3bc0b48b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3bbfff640 1 -- 172.21.15.5:0/1140522575 >> v1:172.21.15.5:6789/0 conn(0x7fd3bc0cdcf0 legacy=0x7fd3bc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.195+0000 7fd3bbfff640 1 -- 172.21.15.5:0/1140522575 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0b4df0 con 0x7fd3bc070b80 2023-11-24T07:56:56.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 Processor -- start 2023-11-24T07:56:56.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 -- start start 2023-11-24T07:56:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3bbfff640 1 --2- 172.21.15.5:0/1140522575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0b2ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097c0 tx=0x7fd3b001e8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae084ff88f560709 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3ba7fc640 1 -- 172.21.15.5:0/1140522575 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00a7970 con 0x7fd3bc070b80 2023-11-24T07:56:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3ba7fc640 1 -- 172.21.15.5:0/1140522575 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b00a7ad0 con 0x7fd3bc070b80 2023-11-24T07:56:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3ba7fc640 1 -- 172.21.15.5:0/1140522575 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00a7e60 con 0x7fd3bc070b80 2023-11-24T07:56:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/1140522575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 msgr2=0x7fd3bc0b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/1140522575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0b2ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097c0 tx=0x7fd3b001e8a0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/1140522575 shutdown_connections 2023-11-24T07:56:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/1140522575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0b2ef0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/1140522575 >> v2:172.21.15.102:3300/0 conn(0x7fd3bc1593c0 0x7fd3bc0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/1140522575 >> 172.21.15.5:0/1140522575 conn(0x7fd3bc06c340 msgr2=0x7fd3bc06c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65100cb9b0 0x7f651006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6510159630 con 0x7f65100cbd90 2023-11-24T07:56:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100cd1d0 con 0x7f65100ce5d0 2023-11-24T07:56:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f65171f5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651015bba0 con 0x7f65100cb9b0 2023-11-24T07:56:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f6514f91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65100cb9b0 0x7f651006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f650ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f65100cbd90 0x7f651015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2023-11-24T07:56:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f650ffff640 1 -- 172.21.15.5:0/51924605 learned_addr learned my addr 172.21.15.5:0/51924605 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/1140522575 shutdown_connections 2023-11-24T07:56:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/1140522575 wait complete. 2023-11-24T07:56:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f6514f91640 1 -- 172.21.15.5:0/51924605 >> v1:172.21.15.102:6789/0 conn(0x7f65100ce5d0 legacy=0x7f651015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f6514f91640 1 -- 172.21.15.5:0/51924605 >> v1:172.21.15.5:6789/0 conn(0x7f65100cbd90 legacy=0x7f651015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.203+0000 7f6514f91640 1 -- 172.21.15.5:0/51924605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100b40d0 con 0x7f65100cb9b0 2023-11-24T07:56:56.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.207+0000 7fd3c1d2a640 1 Processor -- start 2023-11-24T07:56:56.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.207+0000 7fd3c1d2a640 1 -- start start 2023-11-24T07:56:56.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.207+0000 7fd3c1d2a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3c1d2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc0cdcf0 0x7fd3bc159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3c1d2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc1593c0 0x7fd3bc0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f6514f91640 1 --2- 172.21.15.5:0/51924605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f651006e3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65000097c0 tx=0x7f650001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5b91ddee1f1fb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3c1d2a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15a630 con 0x7fd3bc0cdcf0 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3c1d2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15a910 con 0x7fd3bc1593c0 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3c1d2a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15abf0 con 0x7fd3bc070b80 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46540/0 (socket says 172.21.15.5:46540) 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 -- 172.21.15.5:0/376044664 learned_addr learned my addr 172.21.15.5:0/376044664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bbfff640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc1593c0 0x7fd3bc0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 -- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc1593c0 msgr2=0x7fd3bc0aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc1593c0 0x7fd3bc0aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 -- 172.21.15.5:0/376044664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc0cdcf0 msgr2=0x7fd3bc159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc0cdcf0 0x7fd3bc159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7fd3bb7fe640 1 -- 172.21.15.5:0/376044664 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009420 con 0x7fd3bc070b80 2023-11-24T07:56:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f650f7fe640 1 -- 172.21.15.5:0/51924605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000ab600 con 0x7f65100cb9b0 2023-11-24T07:56:56.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f650f7fe640 1 -- 172.21.15.5:0/51924605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000a7050 con 0x7f65100cb9b0 2023-11-24T07:56:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f650f7fe640 1 -- 172.21.15.5:0/51924605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000ab980 con 0x7f65100cb9b0 2023-11-24T07:56:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f65171f5640 1 -- 172.21.15.5:0/51924605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 msgr2=0x7f651006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f65171f5640 1 --2- 172.21.15.5:0/51924605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f651006e3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65000097c0 tx=0x7f650001c440 comp rx=0 tx=0).stop 2023-11-24T07:56:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f65171f5640 1 -- 172.21.15.5:0/51924605 shutdown_connections 2023-11-24T07:56:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3bb7fe640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ba50 tx=0x7fd3b400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f65171f5640 1 --2- 172.21.15.5:0/51924605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f651006e3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.211+0000 7f65171f5640 1 -- 172.21.15.5:0/51924605 >> 172.21.15.5:0/51924605 conn(0x7f65100b0cb0 msgr2=0x7f65100b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7f65171f5640 1 -- 172.21.15.5:0/51924605 shutdown_connections 2023-11-24T07:56:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7f65171f5640 1 -- 172.21.15.5:0/51924605 wait complete. 2023-11-24T07:56:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400cc10 con 0x7fd3bc070b80 2023-11-24T07:56:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400cd70 con 0x7fd3bc070b80 2023-11-24T07:56:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4014680 con 0x7fd3bc070b80 2023-11-24T07:56:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc15aed0 con 0x7fd3bc070b80 2023-11-24T07:56:56.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc14c500 con 0x7fd3bc070b80 2023-11-24T07:56:56.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7f9116e2f640 1 Processor -- start 2023-11-24T07:56:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fe8c1479640 1 Processor -- start 2023-11-24T07:56:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fe8c1479640 1 -- start start 2023-11-24T07:56:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc074990 con 0x7fd3bc070b80 2023-11-24T07:56:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.215+0000 7f9116e2f640 1 -- start start 2023-11-24T07:56:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f65171f5640 1 Processor -- start 2023-11-24T07:56:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f65171f5640 1 -- start start 2023-11-24T07:56:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8c1479640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 0x7fe8bc0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8c1479640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8bc0cd9d0 0x7fe8bc06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8c1479640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc15e140 con 0x7fe8bc06de40 2023-11-24T07:56:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8c1479640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cfe70 con 0x7fe8bc0cd9d0 2023-11-24T07:56:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8c1479640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15d530 con 0x7fe8bc159be0 2023-11-24T07:56:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9116e2f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91100d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8baffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 0x7fe8bc0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8ba7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8bc06de40 0x7fe8bc0c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2023-11-24T07:56:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8ba7fc640 1 -- 172.21.15.5:0/3514359833 learned_addr learned my addr 172.21.15.5:0/3514359833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9116e2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91100ce760 0x7f91100cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9116e2f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100d1610 con 0x7f91100b2840 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9116e2f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911006bda0 con 0x7f91100ce760 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9116e2f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9110166530 con 0x7f91101660d0 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9115e2d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91100b2840 0x7f911006b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35986/0 (socket says 172.21.15.5:35986) 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f9115e2d640 1 -- 172.21.15.5:0/3975588252 learned_addr learned my addr 172.21.15.5:0/3975588252 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8baffd640 1 -- 172.21.15.5:0/3514359833 >> v2:172.21.15.102:3300/0 conn(0x7fe8bc0cd9d0 msgr2=0x7fe8bc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8baffd640 1 --2- 172.21.15.5:0/3514359833 >> v2:172.21.15.102:3300/0 conn(0x7fe8bc0cd9d0 0x7fe8bc06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8baffd640 1 -- 172.21.15.5:0/3514359833 >> v1:172.21.15.5:6789/0 conn(0x7fe8bc06de40 legacy=0x7fe8bc0c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7fe8baffd640 1 -- 172.21.15.5:0/3514359833 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc15d810 con 0x7fe8bc159be0 2023-11-24T07:56:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.219+0000 7f911662e640 1 --2- 172.21.15.5:0/3975588252 >> v2:172.21.15.5:3300/0 conn(0x7f91100ce760 0x7f91100cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3b401d3b0 con 0x7fd3bc070b80 2023-11-24T07:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f9114e2b640 1 -- 172.21.15.5:0/3975588252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105623408 0 0) 0x7f91100d1610 con 0x7f91100b2840 2023-11-24T07:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f9114e2b640 1 -- 172.21.15.5:0/3975588252 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90fc003530 con 0x7f91100b2840 2023-11-24T07:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f911562c640 1 --2- 172.21.15.5:0/3975588252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91100d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7fd3a3fff640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 0x7fd3a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b40841e0 con 0x7fd3bc070b80 2023-11-24T07:56:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f65100b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65100ce5d0 0x7f65100ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100ad3f0 con 0x7f65100cb9b0 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6510072220 con 0x7f65100ce5d0 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f65171f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510155ab0 con 0x7f65100cbd90 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46562/0 (socket says 172.21.15.5:46562) 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 -- 172.21.15.5:0/815322639 learned_addr learned my addr 172.21.15.5:0/815322639 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f6514f91640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f65100b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 -- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65100ce5d0 msgr2=0x7f65100ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65100ce5d0 0x7f65100ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 -- 172.21.15.5:0/815322639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 msgr2=0x7f65100b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f65100b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f650ffff640 1 -- 172.21.15.5:0/815322639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009420 con 0x7f65100cbd90 2023-11-24T07:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7fd3baffd640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 0x7fd3a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7fe8baffd640 1 --2- 172.21.15.5:0/3514359833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 0x7fe8bc0c6810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097c0 tx=0x7fe8b001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e42fedee7e12f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f650ffff640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f650400c530 tx=0x7f650400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8b9ffb640 1 -- 172.21.15.5:0/3514359833 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00ac630 con 0x7fe8bc159be0 2023-11-24T07:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8b9ffb640 1 -- 172.21.15.5:0/3514359833 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b00ac790 con 0x7fe8bc159be0 2023-11-24T07:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8b9ffb640 1 -- 172.21.15.5:0/3514359833 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00acb20 con 0x7fe8bc159be0 2023-11-24T07:56:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504005cf0 con 0x7f65100cbd90 2023-11-24T07:56:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504005e50 con 0x7f65100cbd90 2023-11-24T07:56:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504007270 con 0x7f65100cbd90 2023-11-24T07:56:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3b4051780 con 0x7fd3bc070b80 2023-11-24T07:56:56.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65100addc0 con 0x7f65100cbd90 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 -- 172.21.15.5:0/3514359833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 msgr2=0x7fe8bc0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 --2- 172.21.15.5:0/3514359833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 0x7fe8bc0c6810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097c0 tx=0x7fe8b001c490 comp rx=0 tx=0).stop 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f911562c640 1 -- 172.21.15.5:0/3975588252 >> v2:172.21.15.5:3300/0 conn(0x7f91100ce760 msgr2=0x7f91100cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f911562c640 1 --2- 172.21.15.5:0/3975588252 >> v2:172.21.15.5:3300/0 conn(0x7f91100ce760 0x7f91100cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f911562c640 1 -- 172.21.15.5:0/3975588252 >> v1:172.21.15.5:6789/0 conn(0x7f91100b2840 legacy=0x7f911006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.223+0000 7f911562c640 1 -- 172.21.15.5:0/3975588252 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100d3a00 con 0x7f91101660d0 2023-11-24T07:56:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65100ad080 con 0x7f65100cbd90 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 -- 172.21.15.5:0/3514359833 shutdown_connections 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 --2- 172.21.15.5:0/3514359833 >> v2:172.21.15.102:3300/0 conn(0x7fe8bc0cd9d0 0x7fe8bc06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 --2- 172.21.15.5:0/3514359833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc159be0 0x7fe8bc0c6810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 -- 172.21.15.5:0/3514359833 >> 172.21.15.5:0/3514359833 conn(0x7fe8bc0b22f0 msgr2=0x7fe8bc0b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 -- 172.21.15.5:0/3514359833 shutdown_connections 2023-11-24T07:56:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.227+0000 7fe8c1479640 1 -- 172.21.15.5:0/3514359833 wait complete. 2023-11-24T07:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f911562c640 1 --2- 172.21.15.5:0/3975588252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91100d10d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9108009d90 tx=0x7f910801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf339f794fa721a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9114e2b640 1 -- 172.21.15.5:0/3975588252 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080a5940 con 0x7f91101660d0 2023-11-24T07:56:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7fd3baffd640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 0x7fd3a8068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15b830 tx=0x7fd3ac007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9114e2b640 1 -- 172.21.15.5:0/3975588252 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91080a5aa0 con 0x7f91101660d0 2023-11-24T07:56:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9114e2b640 1 -- 172.21.15.5:0/3975588252 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080a5e70 con 0x7f91101660d0 2023-11-24T07:56:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65040073d0 con 0x7f65100cbd90 2023-11-24T07:56:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65100671f0 con 0x7f65100cbd90 2023-11-24T07:56:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7fe8c1479640 1 Processor -- start 2023-11-24T07:56:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f650d7fa640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 0x7f64fc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 -- 172.21.15.5:0/3975588252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 msgr2=0x7f91100d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 --2- 172.21.15.5:0/3975588252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91100d10d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9108009d90 tx=0x7f910801c990 comp rx=0 tx=0).stop 2023-11-24T07:56:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65040831c0 con 0x7f65100cbd90 2023-11-24T07:56:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 -- 172.21.15.5:0/3975588252 shutdown_connections 2023-11-24T07:56:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 --2- 172.21.15.5:0/3975588252 >> v2:172.21.15.5:3300/0 conn(0x7f91100ce760 0x7f91100cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 --2- 172.21.15.5:0/3975588252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91100d10d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 -- 172.21.15.5:0/3975588252 >> 172.21.15.5:0/3975588252 conn(0x7f911009c670 msgr2=0x7f91100d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f6514f91640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 0x7f64fc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7f6514f91640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 0x7f64fc068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65000ad000 tx=0x7f65000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 -- 172.21.15.5:0/3975588252 shutdown_connections 2023-11-24T07:56:56.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7f9116e2f640 1 -- 172.21.15.5:0/3975588252 wait complete. 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.231+0000 7fe8c1479640 1 -- start start 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 0x7fe8bc14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc159be0 0x7fe8bc167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14e0b0 con 0x7fe8bc0cd9d0 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14d7f0 con 0x7fe8bc159be0 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8c1479640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc168770 con 0x7fe8bc06de40 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8ba7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 0x7fe8bc14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46566/0 (socket says 172.21.15.5:46566) 2023-11-24T07:56:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 -- 172.21.15.5:0/2868109100 learned_addr learned my addr 172.21.15.5:0/2868109100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8bbfff640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc159be0 0x7fe8bc167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7f9116e2f640 1 Processor -- start 2023-11-24T07:56:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7f9116e2f640 1 -- start start 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 -- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc159be0 msgr2=0x7fe8bc167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc159be0 0x7fe8bc167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 -- 172.21.15.5:0/2868109100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 msgr2=0x7fe8bc14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 0x7fe8bc14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 -- 172.21.15.5:0/2868109100 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009420 con 0x7fe8bc06de40 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8ba7fc640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 0x7fe8bc14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8baffd640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8b001a0c0 tx=0x7fe8b0019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 0x7f911015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00b5810 con 0x7fe8bc06de40 2023-11-24T07:56:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b00b5970 con 0x7fe8bc06de40 2023-11-24T07:56:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.235+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00b5ce0 con 0x7fe8bc06de40 2023-11-24T07:56:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6504050860 con 0x7f65100cbd90 2023-11-24T07:56:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc14da60 con 0x7fe8bc06de40 2023-11-24T07:56:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9115e2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9115e2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54900/0 (socket says 172.21.15.5:54900) 2023-11-24T07:56:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91101633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc149ff0 con 0x7fe8bc06de40 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9115e2d640 1 -- 172.21.15.5:0/2195600969 learned_addr learned my addr 172.21.15.5:0/2195600969 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911662e640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91101633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9110162c60 con 0x7f91100ce760 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100b8740 con 0x7f91100b2840 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f9116e2f640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100b8a20 con 0x7f91101660d0 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 0x7f911015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 -- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 msgr2=0x7f91101633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91101633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 -- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 msgr2=0x7f91101648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108009a70 con 0x7f91100ce760 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.239+0000 7f911562c640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 0x7f911015f530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91080ac000 tx=0x7f9108019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f9115e2d640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f911662e640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91101633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080be070 con 0x7f91100ce760 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8b00b3040 con 0x7fe8bc06de40 2023-11-24T07:56:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c005260 con 0x7fe8bc06de40 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7fe8a37fe640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 0x7fe8a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b011e000 con 0x7fe8bc06de40 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91080addb0 con 0x7f91100ce760 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080a5940 con 0x7f91100ce760 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f9116e2f640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100b8d00 con 0x7f91100ce760 2023-11-24T07:56:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f9116e2f640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91100cad40 con 0x7f91100ce760 2023-11-24T07:56:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9110074990 con 0x7f91100ce760 2023-11-24T07:56:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.243+0000 7fe8ba7fc640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 0x7fe8a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.247+0000 7fe8ba7fc640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 0x7fe8a8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc06d6f0 tx=0x7fe8ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.247+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91080b9450 con 0x7f91100ce760 2023-11-24T07:56:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.247+0000 7f91067fc640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 0x7f90f4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.247+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f910811f920 con 0x7f91100ce760 2023-11-24T07:56:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.247+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8b00a8020 con 0x7fe8bc06de40 2023-11-24T07:56:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.251+0000 7f6ee3281640 1 Processor -- start 2023-11-24T07:56:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.251+0000 7f9115e2d640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 0x7f90f4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.251+0000 7f9115e2d640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 0x7f90f4068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91000011f0 tx=0x7f9100009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.251+0000 7f6ee3281640 1 -- start start 2023-11-24T07:56:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.251+0000 7f6ee3281640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 0x7f6edc165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee3281640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6edc06c250 0x7f6edc06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee3281640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 0x7f6edc070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee227f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 0x7f6edc165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91080ecd80 con 0x7f91100ce760 2023-11-24T07:56:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee227f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 0x7f6edc165ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54906/0 (socket says 172.21.15.5:54906) 2023-11-24T07:56:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee3281640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc06cc10 con 0x7f6edc06c250 2023-11-24T07:56:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee227f640 1 -- 172.21.15.5:0/301988436 learned_addr learned my addr 172.21.15.5:0/301988436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc14b470 con 0x7f6edc14b090 2023-11-24T07:56:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc070db0 con 0x7f6edc070400 2023-11-24T07:56:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 --2- 172.21.15.5:0/301988436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 0x7f6edc070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 -- 172.21.15.5:0/301988436 >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 msgr2=0x7f6edc165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 --2- 172.21.15.5:0/301988436 >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 0x7f6edc165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 -- 172.21.15.5:0/301988436 >> v2:172.21.15.5:3300/0 conn(0x7f6edc06c250 msgr2=0x7f6edc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 --2- 172.21.15.5:0/301988436 >> v2:172.21.15.5:3300/0 conn(0x7f6edc06c250 0x7f6edc06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.255+0000 7f6ee2a80640 1 -- 172.21.15.5:0/301988436 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc165a10 con 0x7f6edc070400 2023-11-24T07:56:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee2a80640 1 --2- 172.21.15.5:0/301988436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 0x7f6edc070870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6edc072a10 tx=0x7f6ed401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6021fb082d49532a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee127d640 1 -- 172.21.15.5:0/301988436 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40ab600 con 0x7f6edc070400 2023-11-24T07:56:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee127d640 1 -- 172.21.15.5:0/301988436 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40a7050 con 0x7f6edc070400 2023-11-24T07:56:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee127d640 1 -- 172.21.15.5:0/301988436 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40ab9c0 con 0x7f6edc070400 2023-11-24T07:56:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 msgr2=0x7f6edc070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 --2- 172.21.15.5:0/301988436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 0x7f6edc070870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6edc072a10 tx=0x7f6ed401c360 comp rx=0 tx=0).stop 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 shutdown_connections 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 --2- 172.21.15.5:0/301988436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc070400 0x7f6edc070870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 --2- 172.21.15.5:0/301988436 >> v2:172.21.15.5:3300/0 conn(0x7f6edc06c250 0x7f6edc06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 --2- 172.21.15.5:0/301988436 >> v2:172.21.15.102:3300/0 conn(0x7f6edc14b090 0x7f6edc165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 >> 172.21.15.5:0/301988436 conn(0x7f6edc06df30 msgr2=0x7f6edc06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 shutdown_connections 2023-11-24T07:56:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.263+0000 7f6ee3281640 1 -- 172.21.15.5:0/301988436 wait complete. 2023-11-24T07:56:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.267+0000 7f6ee3281640 1 Processor -- start 2023-11-24T07:56:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.267+0000 7f6ee3281640 1 -- start start 2023-11-24T07:56:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 0x7f6edc0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc14b090 0x7f6edc0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc16c520 con 0x7f6edc070400 2023-11-24T07:56:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1f5d00 con 0x7f6edc06c250 2023-11-24T07:56:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee3281640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1f50f0 con 0x7f6edc14b090 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee227f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee1a7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 0x7f6edc0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee227f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54914/0 (socket says 172.21.15.5:54914) 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee227f640 1 -- 172.21.15.5:0/3583871261 learned_addr learned my addr 172.21.15.5:0/3583871261 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee2a80640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc14b090 0x7f6edc0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee227f640 1 -- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc14b090 msgr2=0x7f6edc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.271+0000 7f6ee227f640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc14b090 0x7f6edc0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee227f640 1 -- 172.21.15.5:0/3583871261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 msgr2=0x7f6edc0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee227f640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 0x7f6edc0afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee227f640 1 -- 172.21.15.5:0/3583871261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009420 con 0x7f6edc06c250 2023-11-24T07:56:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee1a7e640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 0x7f6edc0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee227f640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009fd0 tx=0x7f6ed800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800ddb0 con 0x7f6edc06c250 2023-11-24T07:56:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x7f6edc06c250 2023-11-24T07:56:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc1f53d0 con 0x7f6edc06c250 2023-11-24T07:56:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc1f5990 con 0x7f6edc06c250 2023-11-24T07:56:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.275+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8015620 con 0x7f6edc06c250 2023-11-24T07:56:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.279+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc074990 con 0x7f6edc06c250 2023-11-24T07:56:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.279+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ed8015780 con 0x7f6edc06c250 2023-11-24T07:56:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.283+0000 7f6ed2ffd640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.283+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ed8083cd0 con 0x7f6edc06c250 2023-11-24T07:56:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.283+0000 7f6ee1a7e640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.283+0000 7f6ee1a7e640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 0x7f6ec0068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6edc1f4820 tx=0x7f6ecc009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.287+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ed8089020 con 0x7f6edc06c250 2023-11-24T07:56:56.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.299+0000 7f04aa8ad640 1 Processor -- start 2023-11-24T07:56:56.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.299+0000 7f04aa8ad640 1 -- start start 2023-11-24T07:56:56.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa8ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa8ad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04a406d8a0 0x7f04a406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa8ad640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a406e230 con 0x7f04a4153800 2023-11-24T07:56:56.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa8ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a4072760 con 0x7f04a40b3cd0 2023-11-24T07:56:56.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa8ad640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a40ae970 con 0x7f04a406d8a0 2023-11-24T07:56:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04a90aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04a90aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57024/0 (socket says 172.21.15.5:57024) 2023-11-24T07:56:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04a90aa640 1 -- 172.21.15.5:0/53783481 learned_addr learned my addr 172.21.15.5:0/53783481 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa0ac640 1 --2- 172.21.15.5:0/53783481 >> v2:172.21.15.102:3300/0 conn(0x7f04a406d8a0 0x7f04a406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa0ac640 1 -- 172.21.15.5:0/53783481 >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 msgr2=0x7f04a4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa0ac640 1 --2- 172.21.15.5:0/53783481 >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa0ac640 1 -- 172.21.15.5:0/53783481 >> v1:172.21.15.102:6789/0 conn(0x7f04a4153800 legacy=0x7f04a415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04a88a9640 1 -- 172.21.15.5:0/53783481 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318986502 0 0) 0x7f04a0001120 con 0x7f04a4153800 2023-11-24T07:56:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.303+0000 7f04aa0ac640 1 -- 172.21.15.5:0/53783481 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40721a0 con 0x7f04a406d8a0 2023-11-24T07:56:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.307+0000 7f04a90aa640 1 --2- 172.21.15.5:0/53783481 >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.307+0000 7f1ae7fff640 1 Processor -- start 2023-11-24T07:56:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 -- start start 2023-11-24T07:56:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04aa0ac640 1 --2- 172.21.15.5:0/53783481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a406d8a0 0x7f04a406dcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04a415a980 tx=0x7f049c01ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac636ee0b67dac69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04a88a9640 1 -- 172.21.15.5:0/53783481 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00a2d0 con 0x7f04a406d8a0 2023-11-24T07:56:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ae01052a0 0x7f1ae0052f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ae003a940 0x7f1ae0053480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04a88a9640 1 -- 172.21.15.5:0/53783481 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c0aa050 con 0x7f04a406d8a0 2023-11-24T07:56:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04a88a9640 1 -- 172.21.15.5:0/53783481 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00a650 con 0x7f04a406d8a0 2023-11-24T07:56:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00527d0 con 0x7f1ae004f460 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0052ab0 con 0x7f1ae003a940 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae7fff640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0007220 con 0x7f1ae01052a0 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae67fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1ae004f460 0x7f1ae004f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53320/0 (socket says 172.21.15.5:53320) 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae67fc640 1 -- 172.21.15.5:0/3348267803 learned_addr learned my addr 172.21.15.5:0/3348267803 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/3348267803 >> v2:172.21.15.5:3300/0 conn(0x7f1ae003a940 0x7f1ae0053480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04aa8ad640 1 -- 172.21.15.5:0/53783481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a406d8a0 msgr2=0x7f04a406dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.311+0000 7f04aa8ad640 1 --2- 172.21.15.5:0/53783481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a406d8a0 0x7f04a406dcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04a415a980 tx=0x7f049c01ee80 comp rx=0 tx=0).stop 2023-11-24T07:56:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f1ae5ffb640 1 --2- 172.21.15.5:0/3348267803 >> v2:172.21.15.102:3300/0 conn(0x7f1ae01052a0 0x7f1ae0052f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 -- 172.21.15.5:0/53783481 shutdown_connections 2023-11-24T07:56:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 --2- 172.21.15.5:0/53783481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a406d8a0 0x7f04a406dcf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 --2- 172.21.15.5:0/53783481 >> v2:172.21.15.5:3300/0 conn(0x7f04a40b3cd0 0x7f04a4071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 -- 172.21.15.5:0/53783481 >> 172.21.15.5:0/53783481 conn(0x7f04a40b0c20 msgr2=0x7f04a40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/3348267803 >> v2:172.21.15.102:3300/0 conn(0x7f1ae01052a0 msgr2=0x7f1ae0052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/3348267803 >> v2:172.21.15.102:3300/0 conn(0x7f1ae01052a0 0x7f1ae0052f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/3348267803 >> v1:172.21.15.102:6789/0 conn(0x7f1ae004f460 legacy=0x7f1ae004f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/3348267803 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0007500 con 0x7f1ae003a940 2023-11-24T07:56:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 -- 172.21.15.5:0/53783481 shutdown_connections 2023-11-24T07:56:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/3348267803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae003a940 0x7f1ae0053480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000d540 tx=0x7f1ad801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4441330e97fa7a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 -- 172.21.15.5:0/53783481 wait complete. 2023-11-24T07:56:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 Processor -- start 2023-11-24T07:56:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.315+0000 7f04aa8ad640 1 -- start start 2023-11-24T07:56:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04aa8ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04aa8ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04a98ab640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04a98ab640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46610/0 (socket says 172.21.15.5:46610) 2023-11-24T07:56:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f1aed816640 1 -- 172.21.15.5:0/3348267803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80a5960 con 0x7f1ae003a940 2023-11-24T07:56:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f1aed816640 1 -- 172.21.15.5:0/3348267803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad80a5ac0 con 0x7f1ae003a940 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04a90aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04a90aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57032/0 (socket says 172.21.15.5:57032) 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04a98ab640 1 -- 172.21.15.5:0/1210535416 learned_addr learned my addr 172.21.15.5:0/1210535416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04aa8ad640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 0x7f04a4153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f04aa8ad640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41383f0 con 0x7f04a40b3cd0 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f1ae7fff640 1 -- 172.21.15.5:0/3348267803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae003a940 msgr2=0x7f1ae0053480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.319+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/3348267803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae003a940 0x7f1ae0053480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000d540 tx=0x7f1ad801c8e0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04aa0ac640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 0x7f04a4153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 -- 172.21.15.5:0/3348267803 shutdown_connections 2023-11-24T07:56:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/3348267803 >> v2:172.21.15.102:3300/0 conn(0x7f1ae01052a0 0x7f1ae0052f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/3348267803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae003a940 0x7f1ae0053480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 -- 172.21.15.5:0/3348267803 >> 172.21.15.5:0/3348267803 conn(0x7f1ae0054c00 msgr2=0x7f1ae0054fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04aa8ad640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4138dc0 con 0x7f04a4153800 2023-11-24T07:56:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04aa8ad640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41547e0 con 0x7f04a406d8a0 2023-11-24T07:56:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 -- 172.21.15.5:0/3348267803 shutdown_connections 2023-11-24T07:56:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 -- 172.21.15.5:0/3348267803 wait complete. 2023-11-24T07:56:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 -- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 msgr2=0x7f04a4153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 0x7f04a4153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 -- 172.21.15.5:0/1210535416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 msgr2=0x7f04a41550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940094d0 con 0x7f04a406d8a0 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04aa0ac640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 0x7f04a4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a90aa640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04a98ab640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c750 tx=0x7f04a000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 Processor -- start 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005270 con 0x7f04a406d8a0 2023-11-24T07:56:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f1ae7fff640 1 -- start start 2023-11-24T07:56:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00053f0 con 0x7f04a406d8a0 2023-11-24T07:56:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.323+0000 7f04aa8ad640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c00c050 con 0x7f04a406d8a0 2023-11-24T07:56:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f04aa8ad640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a4138080 con 0x7f04a406d8a0 2023-11-24T07:56:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000a880 con 0x7f04a406d8a0 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ae003a940 0x7f1ae00faa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae004f460 0x7f1ae00303d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00fd460 con 0x7f1ae004f460 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00fc900 con 0x7f1ae01052a0 2023-11-24T07:56:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae7fff640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0030910 con 0x7f1ae003a940 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54938/0 (socket says 172.21.15.5:54938) 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/1604151418 learned_addr learned my addr 172.21.15.5:0/1604151418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f1ae5ffb640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae004f460 0x7f1ae00303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae67fc640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ae003a940 0x7f1ae00faa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ae003a940 msgr2=0x7f1ae00faa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ae003a940 0x7f1ae00faa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/1604151418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae004f460 msgr2=0x7f1ae00303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae004f460 0x7f1ae00303d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 -- 172.21.15.5:0/1604151418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009a70 con 0x7f1ae01052a0 2023-11-24T07:56:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.327+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0480005260 con 0x7f04a406d8a0 2023-11-24T07:56:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04a000a9e0 con 0x7f04a406d8a0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae6ffd640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80194f0 tx=0x7f1ad8019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80adb80 con 0x7f1ae01052a0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad80adce0 con 0x7f1ae01052a0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80b8660 con 0x7f1ae01052a0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00333f0 con 0x7f1ae01052a0 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f049a7fc640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 0x7f0488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a0083290 con 0x7f04a406d8a0 2023-11-24T07:56:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f04a90aa640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 0x7f0488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f04a90aa640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 0x7f0488068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f04a4070d10 tx=0x7f0494009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae00fd0f0 con 0x7f1ae01052a0 2023-11-24T07:56:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.331+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0008520 con 0x7f1ae01052a0 2023-11-24T07:56:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ad80b87c0 con 0x7f1ae01052a0 2023-11-24T07:56:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f1acffff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 0x7f1ad4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad811f2f0 con 0x7f1ae01052a0 2023-11-24T07:56:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04a0050720 con 0x7f04a406d8a0 2023-11-24T07:56:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f1ae67fc640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 0x7f1ad4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.335+0000 7f1ae67fc640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 0x7f1ad4068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005890 tx=0x7f1adc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.339+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ad80ec7e0 con 0x7f1ae01052a0 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 Processor -- start 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 -- start start 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 0x7f671815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671815ecc0 con 0x7f67180cf1b0 2023-11-24T07:56:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180d4420 con 0x7f671815d8f0 2023-11-24T07:56:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671f501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180cdfb0 con 0x7f67180ced30 2023-11-24T07:56:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671ca9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671ca9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:46626/0 (socket says 172.21.15.5:46626) 2023-11-24T07:56:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671ca9c640 1 -- 172.21.15.5:0/1552094694 learned_addr learned my addr 172.21.15.5:0/1552094694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.351+0000 7f671d29d640 1 --2- 172.21.15.5:0/1552094694 >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 0x7f671815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.355+0000 7f671ca9c640 1 -- 172.21.15.5:0/1552094694 >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 msgr2=0x7f671815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.355+0000 7f671ca9c640 1 --2- 172.21.15.5:0/1552094694 >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 0x7f671815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.355+0000 7f671ca9c640 1 -- 172.21.15.5:0/1552094694 >> v1:172.21.15.102:6789/0 conn(0x7f67180cf1b0 legacy=0x7f67180d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.355+0000 7f671ca9c640 1 -- 172.21.15.5:0/1552094694 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180d4140 con 0x7f67180ced30 2023-11-24T07:56:56.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.355+0000 7f671d29d640 1 --2- 172.21.15.5:0/1552094694 >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 0x7f671815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:56.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f671ca9c640 1 --2- 172.21.15.5:0/1552094694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6708009870 tx=0x7f670801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e1ebcba6f99c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f670ffff640 1 -- 172.21.15.5:0/1552094694 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080aa670 con 0x7f67180ced30 2023-11-24T07:56:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f670ffff640 1 -- 172.21.15.5:0/1552094694 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080aa7d0 con 0x7f67180ced30 2023-11-24T07:56:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f670ffff640 1 -- 172.21.15.5:0/1552094694 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080aa670 con 0x7f67180ced30 2023-11-24T07:56:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f671f501640 1 -- 172.21.15.5:0/1552094694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 msgr2=0x7f67180cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.359+0000 7f671f501640 1 --2- 172.21.15.5:0/1552094694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6708009870 tx=0x7f670801c510 comp rx=0 tx=0).stop 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 -- 172.21.15.5:0/1552094694 shutdown_connections 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 --2- 172.21.15.5:0/1552094694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67180ced30 0x7f67180cfe00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 --2- 172.21.15.5:0/1552094694 >> v2:172.21.15.102:3300/0 conn(0x7f671815d8f0 0x7f671815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 -- 172.21.15.5:0/1552094694 >> 172.21.15.5:0/1552094694 conn(0x7f671809c750 msgr2=0x7f67180d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 -- 172.21.15.5:0/1552094694 shutdown_connections 2023-11-24T07:56:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.363+0000 7f671f501640 1 -- 172.21.15.5:0/1552094694 wait complete. 2023-11-24T07:56:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.367+0000 7f671f501640 1 Processor -- start 2023-11-24T07:56:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.367+0000 7f671f501640 1 -- start start 2023-11-24T07:56:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.367+0000 7f671f501640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671f501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 0x7f67180b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671d29d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671d29d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:54950/0 (socket says 172.21.15.5:54950) 2023-11-24T07:56:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671f501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671815d8f0 0x7f67180b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671d29d640 1 -- 172.21.15.5:0/3824707650 learned_addr learned my addr 172.21.15.5:0/3824707650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180b6ba0 con 0x7f67180cf1b0 2023-11-24T07:56:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180b7f90 con 0x7f67180ced30 2023-11-24T07:56:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718144320 con 0x7f671815d8f0 2023-11-24T07:56:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 0x7f67180b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671da9e640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671815d8f0 0x7f67180b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 -- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671815d8f0 msgr2=0x7f67180b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671815d8f0 0x7f67180b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 -- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 msgr2=0x7f67181561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671ca9c640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080094d0 con 0x7f67180cf1b0 2023-11-24T07:56:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.371+0000 7f671d29d640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.375+0000 7f671ca9c640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 0x7f67180b3fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67080ab000 tx=0x7f67080192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.375+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708003620 con 0x7f67180cf1b0 2023-11-24T07:56:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.375+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67180b81c0 con 0x7f67180cf1b0 2023-11-24T07:56:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.379+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67180b8780 con 0x7f67180cf1b0 2023-11-24T07:56:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.379+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708003780 con 0x7f67180cf1b0 2023-11-24T07:56:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.379+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708003af0 con 0x7f67180cf1b0 2023-11-24T07:56:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.379+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671804e850 con 0x7f67180cf1b0 2023-11-24T07:56:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.387+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6708003c50 con 0x7f67180cf1b0 2023-11-24T07:56:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.387+0000 7f670dffb640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 0x7f66fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.387+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f670811ef00 con 0x7f67180cf1b0 2023-11-24T07:56:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.387+0000 7f671d29d640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 0x7f66fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.387+0000 7f671d29d640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 0x7f66fc068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6714006fd0 tx=0x7f6714008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:56.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.395+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67080ec310 con 0x7f67180cf1b0 2023-11-24T07:56:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.567+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65100ad5a0 con 0x7f65100cbd90 2023-11-24T07:56:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.567+0000 7f650d7fa640 1 -- 172.21.15.5:0/815322639 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6504017020 con 0x7f65100cbd90 2023-11-24T07:56:56.572 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-24T07:56:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3bc072470 con 0x7fd3bc070b80 2023-11-24T07:56:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7fd3a3fff640 1 -- 172.21.15.5:0/376044664 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3b4019020 con 0x7fd3bc070b80 2023-11-24T07:56:56.573 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-24T07:56:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 msgr2=0x7f64fc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 0x7f64fc068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65000ad000 tx=0x7f65000a6000 comp rx=0 tx=0).stop 2023-11-24T07:56:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 msgr2=0x7f6510071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f650400c530 tx=0x7f650400c9f0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 shutdown_connections 2023-11-24T07:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64fc0664c0 0x7f64fc068980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65100ce5d0 0x7f65100ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65100cbd90 0x7f6510071ce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 --2- 172.21.15.5:0/815322639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65100cb9b0 0x7f65100b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 >> 172.21.15.5:0/815322639 conn(0x7f65100b0cb0 msgr2=0x7f651015af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 shutdown_connections 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.571+0000 7f65171f5640 1 -- 172.21.15.5:0/815322639 wait complete. 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.575+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 msgr2=0x7fd3a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.575+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 0x7fd3a8068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc15b830 tx=0x7fd3ac007a50 comp rx=0 tx=0).stop 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.575+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 msgr2=0x7fd3bc0ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.575+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ba50 tx=0x7fd3b400bf10 comp rx=0 tx=0).stop 2023-11-24T07:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 shutdown_connections 2023-11-24T07:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd3a8066470 0x7fd3a8068930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc1593c0 0x7fd3bc0aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc0cdcf0 0x7fd3bc159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 --2- 172.21.15.5:0/376044664 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3bc070b80 0x7fd3bc0ae530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 >> 172.21.15.5:0/376044664 conn(0x7fd3bc06c340 msgr2=0x7fd3bc14d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 shutdown_connections 2023-11-24T07:56:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.579+0000 7fd3c1d2a640 1 -- 172.21.15.5:0/376044664 wait complete. 2023-11-24T07:56:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.587+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe89c005510 con 0x7fe8bc06de40 2023-11-24T07:56:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.587+0000 7fe8a37fe640 1 -- 172.21.15.5:0/2868109100 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8b00eb4f0 con 0x7fe8bc06de40 2023-11-24T07:56:56.590 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-24T07:56:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 msgr2=0x7fe8a8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 0x7fe8a8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc06d6f0 tx=0x7fe8ac009040 comp rx=0 tx=0).stop 2023-11-24T07:56:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 msgr2=0x7fe8bc149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8b001a0c0 tx=0x7fe8b0019230 comp rx=0 tx=0).stop 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 shutdown_connections 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8a8066540 0x7fe8a8068a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc159be0 0x7fe8bc167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8bc0cd9d0 0x7fe8bc14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 --2- 172.21.15.5:0/2868109100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc06de40 0x7fe8bc149ab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 >> 172.21.15.5:0/2868109100 conn(0x7fe8bc0b22f0 msgr2=0x7fe8bc06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 shutdown_connections 2023-11-24T07:56:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.591+0000 7fe8c1479640 1 -- 172.21.15.5:0/2868109100 wait complete. 2023-11-24T07:56:56.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-11-24T07:56:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.599+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9110163080 con 0x7f91100ce760 2023-11-24T07:56:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.599+0000 7f91067fc640 1 -- 172.21.15.5:0/2195600969 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91080f03a0 con 0x7f91100ce760 2023-11-24T07:56:56.604 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 msgr2=0x7f90f4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 0x7f90f4068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91000011f0 tx=0x7f9100009040 comp rx=0 tx=0).stop 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 msgr2=0x7f911015f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 0x7f911015f530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91080ac000 tx=0x7f9108019730 comp rx=0 tx=0).stop 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 shutdown_connections 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90f40664c0 0x7f90f4068980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91101660d0 0x7f91101633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91100ce760 0x7f911015f530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 --2- 172.21.15.5:0/2195600969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91100b2840 0x7f91101648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 >> 172.21.15.5:0/2195600969 conn(0x7f911009c670 msgr2=0x7f911006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 shutdown_connections 2023-11-24T07:56:56.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.603+0000 7f90f3fff640 1 -- 172.21.15.5:0/2195600969 wait complete. 2023-11-24T07:56:56.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-11-24T07:56:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6edc06d340 con 0x7f6edc06c250 2023-11-24T07:56:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ed2ffd640 1 -- 172.21.15.5:0/3583871261 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ed801a020 con 0x7f6edc06c250 2023-11-24T07:56:56.623 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 msgr2=0x7f6ec0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 0x7f6ec0068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6edc1f4820 tx=0x7f6ecc009110 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 msgr2=0x7f6edc1f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009fd0 tx=0x7f6ed800d4a0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 shutdown_connections 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6edc14b090 0x7f6edc0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc070400 0x7f6edc0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 --2- 172.21.15.5:0/3583871261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6edc06c250 0x7f6edc1f6190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 >> 172.21.15.5:0/3583871261 conn(0x7f6edc06df30 msgr2=0x7f6edc0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 shutdown_connections 2023-11-24T07:56:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.619+0000 7f6ee3281640 1 -- 172.21.15.5:0/3583871261 wait complete. 2023-11-24T07:56:56.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-24T07:56:56.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-11-24T07:56:56.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-24T07:56:56.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0480005510 con 0x7f04a406d8a0 2023-11-24T07:56:56.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f049a7fc640 1 -- 172.21.15.5:0/1210535416 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04a0053d40 con 0x7f04a406d8a0 2023-11-24T07:56:56.673 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-24T07:56:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 msgr2=0x7f0488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 0x7f0488068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f04a4070d10 tx=0x7f0494009240 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 msgr2=0x7f04a4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c750 tx=0x7f04a000cc10 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 shutdown_connections 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0488066470 0x7f0488068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04a4153800 0x7f04a4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04a40b3cd0 0x7f04a41550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 --2- 172.21.15.5:0/1210535416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04a406d8a0 0x7f04a4138880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 >> 172.21.15.5:0/1210535416 conn(0x7f04a40b0c20 msgr2=0x7f04a415a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.671+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 shutdown_connections 2023-11-24T07:56:56.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.675+0000 7f0487fff640 1 -- 172.21.15.5:0/1210535416 wait complete. 2023-11-24T07:56:56.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.675+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ae0008b10 con 0x7f1ae01052a0 2023-11-24T07:56:56.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1acffff640 1 -- 172.21.15.5:0/1604151418 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ad80efe00 con 0x7f1ae01052a0 2023-11-24T07:56:56.680 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:56.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6718073b60 con 0x7f67180cf1b0 2023-11-24T07:56:56.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f670dffb640 1 -- 172.21.15.5:0/3824707650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67080ec310 con 0x7f67180cf1b0 2023-11-24T07:56:56.682 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-24T07:56:56.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 msgr2=0x7f1ad4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 0x7f1ad4068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005890 tx=0x7f1adc009040 comp rx=0 tx=0).stop 2023-11-24T07:56:56.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 msgr2=0x7f1ae00fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80194f0 tx=0x7f1ad8019680 comp rx=0 tx=0).stop 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 shutdown_connections 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1ad40664c0 0x7f1ad4068980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ae01052a0 0x7f1ae00fb070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae004f460 0x7f1ae00303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1604151418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ae003a940 0x7f1ae00faa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 >> 172.21.15.5:0/1604151418 conn(0x7f1ae0054c00 msgr2=0x7f1ae00365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 shutdown_connections 2023-11-24T07:56:56.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f1ae7fff640 1 -- 172.21.15.5:0/1604151418 wait complete. 2023-11-24T07:56:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 msgr2=0x7f66fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 0x7f66fc068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6714006fd0 tx=0x7f6714008040 comp rx=0 tx=0).stop 2023-11-24T07:56:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 msgr2=0x7f67180b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 0x7f67180b3fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67080ab000 tx=0x7f67080192b0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 shutdown_connections 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f66fc066470 0x7f66fc068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671815d8f0 0x7f67180b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67180cf1b0 0x7f67180b3fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 --2- 172.21.15.5:0/3824707650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67180ced30 0x7f67181561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 >> 172.21.15.5:0/3824707650 conn(0x7f671809c750 msgr2=0x7f67180d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 shutdown_connections 2023-11-24T07:56:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:56.679+0000 7f671f501640 1 -- 172.21.15.5:0/3824707650 wait complete. 2023-11-24T07:56:56.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-24T07:56:56.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-11-24T07:56:56.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-24T07:56:57.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T07:56:57.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T07:56:57.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T07:56:57.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T07:56:57.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T07:56:57.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T07:56:57.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T07:56:57.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T07:56:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.787+0000 7fcea211e640 1 Processor -- start 2023-11-24T07:56:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.787+0000 7fcea211e640 1 -- start start 2023-11-24T07:56:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.791+0000 7fcea211e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 0x7fce9c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.791+0000 7fcea211e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce9c0b3cd0 0x7fce9c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.791+0000 7fcea111c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 0x7fce9c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.791+0000 7fcea111c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 0x7fce9c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57280/0 (socket says 172.21.15.5:57280) 2023-11-24T07:56:57.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.791+0000 7fcea191d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fce9c06d8a0 0x7fce9c0b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53690/0 (socket says 172.21.15.5:53690) 2023-11-24T07:56:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce9c0b3cd0 0x7fce9c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce9c0b3cd0 0x7fce9c15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45110/0 (socket says 172.21.15.5:45110) 2023-11-24T07:56:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea111c640 1 -- 172.21.15.5:0/1543959590 learned_addr learned my addr 172.21.15.5:0/1543959590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c072760 con 0x7fce9c06d8a0 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0ae970 con 0x7fce9c153800 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0721a0 con 0x7fce9c0b3cd0 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144582674 0 0) 0x7fce9c072760 con 0x7fce9c06d8a0 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce88007940 con 0x7fce9c06d8a0 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 25707942 0 0) 0x7fce88007940 con 0x7fce9c06d8a0 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 >> v2:172.21.15.102:3300/0 conn(0x7fce9c0b3cd0 msgr2=0x7fce9c15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 --2- 172.21.15.5:0/1543959590 >> v2:172.21.15.102:3300/0 conn(0x7fce9c0b3cd0 0x7fce9c15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 msgr2=0x7fce9c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 --2- 172.21.15.5:0/1543959590 >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 0x7fce9c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c072480 con 0x7fce9c06d8a0 2023-11-24T07:56:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7fce8c001680 con 0x7fce9c06d8a0 2023-11-24T07:56:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 >> v1:172.21.15.102:6789/0 conn(0x7fce9c06d8a0 legacy=0x7fce9c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88007d90 0x7fce880081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 0x7fce88009060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce880095a0 0x7fce8800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0ae970 con 0x7fce880095a0 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0721a0 con 0x7fce88008be0 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce88010470 con 0x7fce88007d90 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 0x7fce88009060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea111c640 1 --2- 172.21.15.5:0/1543959590 >> v2:172.21.15.5:3300/0 conn(0x7fce9c153800 0x7fce9c071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea191d640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce880095a0 0x7fce8800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 -- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88007d90 msgr2=0x7fce880081b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88007d90 0x7fce880081b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 -- 172.21.15.5:0/1543959590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce880095a0 msgr2=0x7fce8800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce880095a0 0x7fce8800fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea091b640 1 -- 172.21.15.5:0/1543959590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c072480 con 0x7fce88008be0 2023-11-24T07:56:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea191d640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce880095a0 0x7fce8800fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.795+0000 7fcea191d640 1 -- 172.21.15.5:0/1543959590 reap_dead start 2023-11-24T07:56:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fcea091b640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 0x7fce88009060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce94008f80 tx=0x7fce9401d100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5636c0fcf0d3a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9400b2d0 con 0x7fce88008be0 2023-11-24T07:56:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce940a8050 con 0x7fce88008be0 2023-11-24T07:56:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 msgr2=0x7fce88009060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fce93fff640 1 -- 172.21.15.5:0/1543959590 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9400b2d0 con 0x7fce88008be0 2023-11-24T07:56:57.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.803+0000 7fcea211e640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 0x7fce88009060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce94008f80 tx=0x7fce9401d100 comp rx=0 tx=0).stop 2023-11-24T07:56:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.807+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 shutdown_connections 2023-11-24T07:56:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.807+0000 7fcea211e640 1 --2- 172.21.15.5:0/1543959590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce88008be0 0x7fce88009060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.807+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 >> 172.21.15.5:0/1543959590 conn(0x7fce9c0b0c20 msgr2=0x7fce9c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.807+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 shutdown_connections 2023-11-24T07:56:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.807+0000 7fcea211e640 1 -- 172.21.15.5:0/1543959590 wait complete. 2023-11-24T07:56:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 Processor -- start 2023-11-24T07:56:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 -- start start 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce9c203bb0 0x7fce9c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c151630 con 0x7fce9c155130 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c204030 con 0x7fce9c203bb0 2023-11-24T07:56:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea211e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c154090 con 0x7fce88008be0 2023-11-24T07:56:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea191d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea111c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea111c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45594/0 (socket says 172.21.15.5:45594) 2023-11-24T07:56:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea111c640 1 -- 172.21.15.5:0/4132680817 learned_addr learned my addr 172.21.15.5:0/4132680817 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea191d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57296/0 (socket says 172.21.15.5:57296) 2023-11-24T07:56:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.811+0000 7fcea091b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce9c203bb0 0x7fce9c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 -- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 msgr2=0x7fce9c1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 -- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce9c203bb0 msgr2=0x7fce9c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce9c203bb0 0x7fce9c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 -- 172.21.15.5:0/4132680817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c154370 con 0x7fce9c155130 2023-11-24T07:56:57.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea111c640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea191d640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b1b90 tx=0x7fce8c010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00eb00 con 0x7fce9c155130 2023-11-24T07:56:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c00ec60 con 0x7fce9c155130 2023-11-24T07:56:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00eb00 con 0x7fce9c155130 2023-11-24T07:56:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea211e640 1 -- 172.21.15.5:0/4132680817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c154650 con 0x7fce9c155130 2023-11-24T07:56:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.815+0000 7fcea211e640 1 -- 172.21.15.5:0/4132680817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c154c10 con 0x7fce9c155130 2023-11-24T07:56:57.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.819+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce8c035410 con 0x7fce9c155130 2023-11-24T07:56:57.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.823+0000 7fcea211e640 1 -- 172.21.15.5:0/4132680817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c005260 con 0x7fce9c155130 2023-11-24T07:56:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.823+0000 7fce91ffb640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 0x7fce80068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.823+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce8c0866d0 con 0x7fce9c155130 2023-11-24T07:56:57.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.827+0000 7fcea111c640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 0x7fce80068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.827+0000 7fcea111c640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 0x7fce80068990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b0420 tx=0x7fce98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.831+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce8c01a020 con 0x7fce9c155130 2023-11-24T07:56:57.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 Processor -- start 2023-11-24T07:56:57.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 -- start start 2023-11-24T07:56:57.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd8072280 0x7f5cd80b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cd77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd80cbd20 con 0x7f5cd815cc80 2023-11-24T07:56:57.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cd77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45130/0 (socket says 172.21.15.5:45130) 2023-11-24T07:56:57.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cd77fe640 1 -- 172.21.15.5:0/3764094038 learned_addr learned my addr 172.21.15.5:0/3764094038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f791c646640 1 Processor -- start 2023-11-24T07:56:57.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cdc90f640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd8072280 0x7f5cd80b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 Processor -- start 2023-11-24T07:56:57.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 -- start start 2023-11-24T07:56:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80b4260 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.883+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80cc810 con 0x7f5cd8072280 2023-11-24T07:56:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f5cd77fe640 1 -- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd8072280 msgr2=0x7f5cd80b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f5cd77fe640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd8072280 0x7f5cd80b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f5cd77fe640 1 -- 172.21.15.5:0/3764094038 >> v1:172.21.15.5:6789/0 conn(0x7f5cd815cc80 legacy=0x7f5cd806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 -- start start 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe400033e10 0x7fe4000eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400037b90 con 0x7fe400047bf0 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40004f060 con 0x7fe400005ec0 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40f0f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000501e0 con 0x7fe400033e10 2023-11-24T07:56:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7fe40e0f3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe400033e10 0x7fe4000eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 Processor -- start 2023-11-24T07:56:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 -- start start 2023-11-24T07:56:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16c40b4690 0x7f16c40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c41620d0 con 0x7f16c4162960 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40b3510 con 0x7f16c40b4690 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16cc73e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40b2a60 con 0x7f16c40b25d0 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16ca4da640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f16c4162960 0x7f16c40b3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53712/0 (socket says 172.21.15.5:53712) 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f16ca4da640 1 -- 172.21.15.5:0/2837457974 learned_addr learned my addr 172.21.15.5:0/2837457974 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40e0f3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe400033e10 0x7fe4000eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45138/0 (socket says 172.21.15.5:45138) 2023-11-24T07:56:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40e0f3640 1 -- 172.21.15.5:0/2818997375 learned_addr learned my addr 172.21.15.5:0/2818997375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16cacdb640 1 --2- 172.21.15.5:0/2837457974 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16c9cd9640 1 --2- 172.21.15.5:0/2837457974 >> v2:172.21.15.5:3300/0 conn(0x7f16c40b4690 0x7f16c40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f5cd77fe640 1 -- 172.21.15.5:0/3764094038 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8072960 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f791414af40 0x7f7914070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79140b46b0 0x7f79140b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79140b2350 con 0x7f791414b320 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7914070a50 con 0x7f791414af40 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791c646640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7914070d30 con 0x7f79140b46b0 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791abe3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79140b46b0 0x7f79140b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791abe3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79140b46b0 0x7f79140b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45134/0 (socket says 172.21.15.5:45134) 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791abe3640 1 -- 172.21.15.5:0/2764097584 learned_addr learned my addr 172.21.15.5:0/2764097584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.887+0000 7f791a3e2640 1 --2- 172.21.15.5:0/2764097584 >> v2:172.21.15.5:3300/0 conn(0x7f791414af40 0x7f7914070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f791abe3640 1 -- 172.21.15.5:0/2764097584 >> v2:172.21.15.5:3300/0 conn(0x7f791414af40 msgr2=0x7f7914070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f791abe3640 1 --2- 172.21.15.5:0/2764097584 >> v2:172.21.15.5:3300/0 conn(0x7f791414af40 0x7f7914070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f791abe3640 1 -- 172.21.15.5:0/2764097584 >> v1:172.21.15.102:6789/0 conn(0x7f791414b320 legacy=0x7f79140b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f791abe3640 1 -- 172.21.15.5:0/2764097584 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914071010 con 0x7f79140b46b0 2023-11-24T07:56:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532493017 0 0) 0x7fe40004f060 con 0x7fe400005ec0 2023-11-24T07:56:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f4003530 con 0x7fe400005ec0 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16c94d8640 1 -- 172.21.15.5:0/2837457974 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406297316 0 0) 0x7f16c41620d0 con 0x7f16c4162960 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16c94d8640 1 -- 172.21.15.5:0/2837457974 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b0003530 con 0x7f16c4162960 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16cacdb640 1 -- 172.21.15.5:0/2837457974 >> v2:172.21.15.5:3300/0 conn(0x7f16c40b4690 msgr2=0x7f16c40b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16cacdb640 1 --2- 172.21.15.5:0/2837457974 >> v2:172.21.15.5:3300/0 conn(0x7f16c40b4690 0x7f16c40b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16cacdb640 1 -- 172.21.15.5:0/2837457974 >> v1:172.21.15.102:6789/0 conn(0x7f16c4162960 legacy=0x7f16c40b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7f16cacdb640 1 -- 172.21.15.5:0/2837457974 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40b2c70 con 0x7f16c40b25d0 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910202294 0 0) 0x7fe3f4003530 con 0x7fe400005ec0 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 >> v2:172.21.15.102:3300/0 conn(0x7fe400033e10 msgr2=0x7fe4000eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 --2- 172.21.15.5:0/2818997375 >> v2:172.21.15.102:3300/0 conn(0x7fe400033e10 0x7fe4000eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 >> v1:172.21.15.5:6789/0 conn(0x7fe400047bf0 legacy=0x7fe4000eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40004fd50 con 0x7fe400005ec0 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7fe40804ed70 con 0x7fe400005ec0 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 >> v1:172.21.15.102:6789/0 conn(0x7fe400005ec0 legacy=0x7fe4000062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f40039a0 0x7fe3f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3f40047d0 0x7fe3f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe3f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000501e0 con 0x7fe3f40039a0 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f400c040 con 0x7fe3f4005190 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f400c200 con 0x7fe3f40047d0 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.891+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe3f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cd77fe640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c920 tx=0x7f5ccc01e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afef723a62cf4e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e0f3640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f40039a0 0x7fe3f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e8f4640 1 -- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3f40047d0 msgr2=0x7fe3f4004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3f40047d0 0x7fe3f4004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e8f4640 1 -- 172.21.15.5:0/2818997375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f40039a0 msgr2=0x7fe3f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f40039a0 0x7fe3f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7fe40e8f4640 1 -- 172.21.15.5:0/2818997375 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40004f060 con 0x7fe3f4005190 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cd6ffd640 1 -- 172.21.15.5:0/3764094038 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00c390 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cd6ffd640 1 -- 172.21.15.5:0/3764094038 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0a7600 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cd6ffd640 1 -- 172.21.15.5:0/3764094038 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a7990 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f791abe3640 1 --2- 172.21.15.5:0/2764097584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79140b46b0 0x7f79140b2f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79140b34d0 tx=0x7f791001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=571e8c5dd0aa0d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f79193e0640 1 -- 172.21.15.5:0/2764097584 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100ab640 con 0x7f79140b46b0 2023-11-24T07:56:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f79193e0640 1 -- 172.21.15.5:0/2764097584 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100a7070 con 0x7f79140b46b0 2023-11-24T07:56:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f79193e0640 1 -- 172.21.15.5:0/2764097584 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100ab9c0 con 0x7f79140b46b0 2023-11-24T07:56:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd80b1fb0 msgr2=0x7f5cd80b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c920 tx=0x7f5ccc01e880 comp rx=0 tx=0).stop 2023-11-24T07:56:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 shutdown_connections 2023-11-24T07:56:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd8072280 0x7f5cd80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f791c646640 1 -- 172.21.15.5:0/2764097584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79140b46b0 msgr2=0x7f79140b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f791c646640 1 --2- 172.21.15.5:0/2764097584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79140b46b0 0x7f79140b2f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79140b34d0 tx=0x7f791001c460 comp rx=0 tx=0).stop 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 -- 172.21.15.5:0/2764097584 shutdown_connections 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 --2- 172.21.15.5:0/2764097584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79140b46b0 0x7f79140b2f60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 --2- 172.21.15.5:0/2764097584 >> v2:172.21.15.5:3300/0 conn(0x7f791414af40 0x7f7914070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 -- 172.21.15.5:0/2764097584 >> 172.21.15.5:0/2764097584 conn(0x7f79140b0d90 msgr2=0x7f79140b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f16cacdb640 1 --2- 172.21.15.5:0/2837457974 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4070b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009d90 tx=0x7f16bc01c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5273b70b0d6dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16c94d8640 1 -- 172.21.15.5:0/2837457974 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8001680 con 0x7f16c40b25d0 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16c94d8640 1 -- 172.21.15.5:0/2837457974 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0a55d0 con 0x7f16c40b25d0 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16c94d8640 1 -- 172.21.15.5:0/2837457974 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a5960 con 0x7f16c40b25d0 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 --2- 172.21.15.5:0/3764094038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd80b1fb0 0x7f5cd80b37e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.895+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 >> 172.21.15.5:0/3764094038 conn(0x7f5cd80b0cb0 msgr2=0x7f5cd80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 shutdown_connections 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f5cde372640 1 -- 172.21.15.5:0/3764094038 wait complete. 2023-11-24T07:56:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 -- 172.21.15.5:0/2764097584 shutdown_connections 2023-11-24T07:56:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 -- 172.21.15.5:0/2764097584 wait complete. 2023-11-24T07:56:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7fe40e8f4640 1 -- 172.21.15.5:0/2818997375 reap_dead start 2023-11-24T07:56:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe3f400b990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4080643d0 tx=0x7fe408099b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c0197bca95500d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 -- 172.21.15.5:0/2837457974 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 msgr2=0x7f16c4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2837457974 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4070b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009d90 tx=0x7f16bc01c790 comp rx=0 tx=0).stop 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 -- 172.21.15.5:0/2837457974 shutdown_connections 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2837457974 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4070b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2837457974 >> v2:172.21.15.5:3300/0 conn(0x7f16c40b4690 0x7f16c40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 -- 172.21.15.5:0/2837457974 >> 172.21.15.5:0/2837457974 conn(0x7f16c406c340 msgr2=0x7f16c406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408124780 con 0x7fe3f4005190 2023-11-24T07:56:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4081248e0 con 0x7fe3f4005190 2023-11-24T07:56:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7fe40d0f1640 1 -- 172.21.15.5:0/2818997375 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408124c70 con 0x7fe3f4005190 2023-11-24T07:56:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 -- 172.21.15.5:0/2837457974 shutdown_connections 2023-11-24T07:56:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f16cc73e640 1 -- 172.21.15.5:0/2837457974 wait complete. 2023-11-24T07:56:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 Processor -- start 2023-11-24T07:56:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.899+0000 7f791c646640 1 -- start start 2023-11-24T07:56:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 -- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 msgr2=0x7fe3f400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f5cde372640 1 Processor -- start 2023-11-24T07:56:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe3f400b990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4080643d0 tx=0x7fe408099b10 comp rx=0 tx=0).stop 2023-11-24T07:56:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 -- 172.21.15.5:0/2818997375 shutdown_connections 2023-11-24T07:56:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f791414af40 0x7f79141687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f791414b320 0x7f79141491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 --2- 172.21.15.5:0/2818997375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe3f400b990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f5cde372640 1 -- start start 2023-11-24T07:56:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 -- 172.21.15.5:0/2818997375 >> 172.21.15.5:0/2818997375 conn(0x7fe400009f90 msgr2=0x7fe40000a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 -- 172.21.15.5:0/2818997375 shutdown_connections 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7fe40f0f5640 1 -- 172.21.15.5:0/2818997375 wait complete. 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7914168ce0 con 0x7f791414b320 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79141608a0 con 0x7f791414af40 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791c646640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7914160b80 con 0x7f79140b46b0 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791abe3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f791414b320 0x7f79141491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45626/0 (socket says 172.21.15.5:45626) 2023-11-24T07:56:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 -- 172.21.15.5:0/2106208370 learned_addr learned my addr 172.21.15.5:0/2106208370 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f16cc73e640 1 Processor -- start 2023-11-24T07:56:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f16cc73e640 1 -- start start 2023-11-24T07:56:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 -- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f791414af40 msgr2=0x7f79141687a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f791414af40 0x7f79141687a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 -- 172.21.15.5:0/2106208370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f791414b320 msgr2=0x7f79141491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f791414b320 0x7f79141491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f791a3e2640 1 -- 172.21.15.5:0/2106208370 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100094d0 con 0x7f79140b46b0 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f16cc73e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.903+0000 7f16cc73e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 0x7f16c4143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 Processor -- start 2023-11-24T07:56:57.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f791a3e2640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f790400e930 tx=0x7f790400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16ca4da640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16ca4da640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45628/0 (socket says 172.21.15.5:45628) 2023-11-24T07:56:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45156/0 (socket says 172.21.15.5:45156) 2023-11-24T07:56:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 -- start start 2023-11-24T07:56:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904009690 con 0x7f79140b46b0 2023-11-24T07:56:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790400ca00 con 0x7f79140b46b0 2023-11-24T07:56:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16ca4da640 1 -- 172.21.15.5:0/2893686263 learned_addr learned my addr 172.21.15.5:0/2893686263 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790400cd70 con 0x7f79140b46b0 2023-11-24T07:56:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7914160e60 con 0x7f79140b46b0 2023-11-24T07:56:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791416a550 con 0x7f79140b46b0 2023-11-24T07:56:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41408d0 con 0x7f16c4162960 2023-11-24T07:56:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4165710 con 0x7f16c40b4690 2023-11-24T07:56:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41659f0 con 0x7f16c40b25d0 2023-11-24T07:56:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cacdb640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 0x7f16c4143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 -- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 msgr2=0x7f16c4163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 -- 172.21.15.5:0/2893686263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 msgr2=0x7f16c4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 0x7f16c4143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc009a70 con 0x7f16c40b4690 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cacdb640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 0x7f16c4143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16ca4da640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16c9cd9640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e8a0 tx=0x7f16c000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd80b1fb0 0x7f5cd815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 0x7f5cd815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd81521c0 con 0x7f5cd815cc80 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8099cb0 con 0x7f5cd8072280 2023-11-24T07:56:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cde372640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8158450 con 0x7f5cd80b1fb0 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe40004e4f0 0x7fe400176f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45178/0 (socket says 172.21.15.5:45178) 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cd7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cdc90f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 0x7f5cd815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cd7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45164/0 (socket says 172.21.15.5:45164) 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f5cd7fff640 1 -- 172.21.15.5:0/2814386993 learned_addr learned my addr 172.21.15.5:0/2814386993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 -- 172.21.15.5:0/3778279009 learned_addr learned my addr 172.21.15.5:0/3778279009 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 0x7fe4000de590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40d8f2640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe40004e4f0 0x7fe400176f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 0x7fe4000de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40017e0a0 con 0x7fe40004e4f0 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40004d450 con 0x7fe3f4005190 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40f0f5640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40004d730 con 0x7fe40004e970 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 -- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 msgr2=0x7fe4000de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 0x7fe4000de590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 -- 172.21.15.5:0/3778279009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe40004e4f0 msgr2=0x7fe400176f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000c940 con 0x7f16c40b4690 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000caa0 con 0x7f16c40b4690 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000ce10 con 0x7f16c40b4690 2023-11-24T07:56:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c4165cd0 con 0x7f16c40b4690 2023-11-24T07:56:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c414cd90 con 0x7f16c40b4690 2023-11-24T07:56:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe40004e4f0 0x7fe400176f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7fe40e0f3640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40004da10 con 0x7fe3f4005190 2023-11-24T07:56:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe40e8f4640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 0x7fe4000de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe40e0f3640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe404009220 tx=0x7fe404011a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cd77fe640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd80b1fb0 0x7f5cd815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 -- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd80b1fb0 msgr2=0x7f5cd815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd80b1fb0 0x7f5cd815a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 -- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 msgr2=0x7f5cd8151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 -- 172.21.15.5:0/2814386993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc00c600 con 0x7f5cd815cc80 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cd7fff640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400c070 con 0x7fe3f4005190 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe404015870 con 0x7fe3f4005190 2023-11-24T07:56:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404015c00 con 0x7fe3f4005190 2023-11-24T07:56:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cdc90f640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 0x7f5cd815ad60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800e7f0 tx=0x7f5cc800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.907+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7904013470 con 0x7f79140b46b0 2023-11-24T07:56:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f790affd640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 0x7f78f8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7904084050 con 0x7f79140b46b0 2023-11-24T07:56:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe40f0f5640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40004dcf0 con 0x7fe3f4005190 2023-11-24T07:56:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7fe40f0f5640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40004d120 con 0x7fe3f4005190 2023-11-24T07:56:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c4140a80 con 0x7f16c40b4690 2023-11-24T07:56:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16c0013470 con 0x7f16c40b4690 2023-11-24T07:56:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc005260 con 0x7f79140b46b0 2023-11-24T07:56:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800c730 con 0x7f5cd815cc80 2023-11-24T07:56:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd8158730 con 0x7f5cd815cc80 2023-11-24T07:56:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f7919be1640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 0x7f78f8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f16b6ffd640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 0x7f16a8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16c00841a0 con 0x7f16c40b4690 2023-11-24T07:56:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd8099f20 con 0x7f5cd815cc80 2023-11-24T07:56:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.911+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800c890 con 0x7f5cd815cc80 2023-11-24T07:56:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800c730 con 0x7f5cd815cc80 2023-11-24T07:56:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f16ca4da640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 0x7f16a8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f16ca4da640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 0x7f16a8068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001770 tx=0x7f16b80016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8005260 con 0x7f5cd815cc80 2023-11-24T07:56:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e4005260 con 0x7fe3f4005190 2023-11-24T07:56:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f7919be1640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 0x7f78f8068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f790c007fd0 tx=0x7f790c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe40400f460 con 0x7fe3f4005190 2023-11-24T07:56:57.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7fe3feffd640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 0x7fe3ec068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.915+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cc800ca00 con 0x7f5cd815cc80 2023-11-24T07:56:57.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe404055330 con 0x7fe3f4005190 2023-11-24T07:56:57.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7fe40d8f2640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 0x7fe3ec068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16c4140a80 con 0x7f16c40b4690 2023-11-24T07:56:57.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f5cd4ff9640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 0x7f5cc4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cc8083d80 con 0x7f5cd815cc80 2023-11-24T07:56:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f5cd7fff640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 0x7f5cc4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7904017080 con 0x7f79140b46b0 2023-11-24T07:56:57.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7fe40d8f2640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 0x7fe3ec068980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8007fd0 tx=0x7fe3f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.919+0000 7f5cd7fff640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 0x7f5cc4068990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0002240 tx=0x7f5cd0001ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.923+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe404051e00 con 0x7fe3f4005190 2023-11-24T07:56:57.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.931+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cc8051340 con 0x7f5cd815cc80 2023-11-24T07:56:57.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.967+0000 7f9de6859640 1 Processor -- start 2023-11-24T07:56:57.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.967+0000 7f3c96e47640 1 Processor -- start 2023-11-24T07:56:57.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.967+0000 7f9de6859640 1 -- start start 2023-11-24T07:56:57.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.967+0000 7f3c96e47640 1 -- start start 2023-11-24T07:56:57.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c96e47640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c88053ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c96e47640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c8804fa50 0x7f3c8804ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c96e47640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c88005ec0 con 0x7f3c88053060 2023-11-24T07:56:57.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c96e47640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c88050440 con 0x7f3c8804fa50 2023-11-24T07:56:57.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c96e47640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88006160 con 0x7f3c880df260 2023-11-24T07:56:57.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6859640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de015b2d0 0x7f9de00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c95e45640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c88053ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6859640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9de00d38d0 0x7f9de00b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c95e45640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c88053ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45662/0 (socket says 172.21.15.5:45662) 2023-11-24T07:56:57.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6859640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de015b6b0 con 0x7f9de00b5250 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c95e45640 1 -- 172.21.15.5:0/3872362887 learned_addr learned my addr 172.21.15.5:0/3872362887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6859640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de015ebd0 con 0x7f9de00d38d0 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6859640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00d3d40 con 0x7f9de015b2d0 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6058640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9de00d38d0 0x7f9de00b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6058640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9de00d38d0 0x7f9de00b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45190/0 (socket says 172.21.15.5:45190) 2023-11-24T07:56:57.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f9de6058640 1 -- 172.21.15.5:0/1510236025 learned_addr learned my addr 172.21.15.5:0/1510236025 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207417193 0 0) 0x7f3c88005ec0 con 0x7f3c88053060 2023-11-24T07:56:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.971+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c003530 con 0x7f3c88053060 2023-11-24T07:56:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795486926 0 0) 0x7f9de015b6b0 con 0x7f9de00b5250 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc003530 con 0x7f9de00b5250 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581748061 0 0) 0x7f9dcc003530 con 0x7f9de00b5250 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de015b2d0 msgr2=0x7f9de00ce7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de015b2d0 0x7f9de00ce7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 >> v2:172.21.15.102:3300/0 conn(0x7f9de00d38d0 msgr2=0x7f9de00b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 --2- 172.21.15.5:0/1510236025 >> v2:172.21.15.102:3300/0 conn(0x7f9de00d38d0 0x7f9de00b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00cda70 con 0x7f9de00b5250 2023-11-24T07:56:57.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f9dd0001680 con 0x7f9de00b5250 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 >> v1:172.21.15.102:6789/0 conn(0x7f9de00b5250 legacy=0x7f9de00d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc003980 0x7f9dcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0047d0 0x7f9dcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc005190 0x7f9dcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de015ebd0 con 0x7f9dcc005190 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00d3d40 con 0x7f9dcc003980 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc00c000 con 0x7f9dcc0047d0 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 880394309 0 0) 0x7f3c7c003530 con 0x7f3c88053060 2023-11-24T07:56:57.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 msgr2=0x7f3c88053ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c88053ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 >> v2:172.21.15.5:3300/0 conn(0x7f3c8804fa50 msgr2=0x7f3c8804ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c96646640 1 --2- 172.21.15.5:0/3872362887 >> v2:172.21.15.5:3300/0 conn(0x7f3c8804fa50 0x7f3c8804ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 --2- 172.21.15.5:0/3872362887 >> v2:172.21.15.5:3300/0 conn(0x7f3c8804fa50 0x7f3c8804ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88006440 con 0x7f3c88053060 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f3c80001680 con 0x7f3c88053060 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 >> v1:172.21.15.102:6789/0 conn(0x7f3c88053060 legacy=0x7f3c88007200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c7c003770 0x7f3c7c003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c7c0040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c7c00b0d0 0x7f3c7c00d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0047d0 0x7f9dcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88050440 con 0x7f3c7c003770 2023-11-24T07:56:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88006160 con 0x7f3c7c00b0d0 2023-11-24T07:56:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00dd90 con 0x7f3c880df260 2023-11-24T07:56:57.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c96646640 1 --2- 172.21.15.5:0/3872362887 >> v2:172.21.15.5:3300/0 conn(0x7f3c8804fa50 0x7f3c8804ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c7c0040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c96646640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c7c00b0d0 0x7f3c7c00d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 -- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c7c00b0d0 msgr2=0x7f3c7c00d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c7c00b0d0 0x7f3c7c00d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 -- 172.21.15.5:0/3872362887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c7c003770 msgr2=0x7f3c7c003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c7c003770 0x7f3c7c003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f3c95644640 1 -- 172.21.15.5:0/3872362887 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88006440 con 0x7f3c880df260 2023-11-24T07:56:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 -- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc003980 msgr2=0x7f9dcc003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T07:56:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc003980 0x7f9dcc003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 -- 172.21.15.5:0/1510236025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc005190 msgr2=0x7f9dcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de6058640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc005190 0x7f9dcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc005190 0x7f9dcc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.975+0000 7f9de5056640 1 -- 172.21.15.5:0/1510236025 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00cda70 con 0x7f9dcc0047d0 2023-11-24T07:56:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.979+0000 7f9de6058640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc005190 0x7f9dcc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.979+0000 7f3c95644640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c7c0040d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e570 tx=0x7f3c8001caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbccd508ba3c4f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.979+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000e2d0 con 0x7f3c880df260 2023-11-24T07:56:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.979+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800a5860 con 0x7f3c880df260 2023-11-24T07:56:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 -- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 msgr2=0x7f3c7c0040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c94e43640 1 -- 172.21.15.5:0/3872362887 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000e2d0 con 0x7f3c880df260 2023-11-24T07:56:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3872362887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c880df260 0x7f3c7c0040d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e570 tx=0x7f3c8001caa0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96646640 1 -- 172.21.15.5:0/3872362887 reap_dead start 2023-11-24T07:56:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de5056640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0047d0 0x7f9dcc004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c190 tx=0x7f9dd001cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4cbd8b592d55233 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 -- 172.21.15.5:0/3872362887 shutdown_connections 2023-11-24T07:56:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 -- 172.21.15.5:0/3872362887 >> 172.21.15.5:0/3872362887 conn(0x7f3c88009f90 msgr2=0x7f3c8800a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 -- 172.21.15.5:0/3872362887 shutdown_connections 2023-11-24T07:56:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00a5ac0 con 0x7f9dcc0047d0 2023-11-24T07:56:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd00a5c20 con 0x7f9dcc0047d0 2023-11-24T07:56:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de4855640 1 -- 172.21.15.5:0/1510236025 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00ad660 con 0x7f9dcc0047d0 2023-11-24T07:56:57.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f3c96e47640 1 -- 172.21.15.5:0/3872362887 wait complete. 2023-11-24T07:56:57.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f3c96e47640 1 Processor -- start 2023-11-24T07:56:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f3c96e47640 1 -- start start 2023-11-24T07:56:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de6859640 1 -- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0047d0 msgr2=0x7f9dcc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.983+0000 7f9de6859640 1 --2- 172.21.15.5:0/1510236025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0047d0 0x7f9dcc004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c190 tx=0x7f9dd001cbc0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f9de6058640 1 -- 172.21.15.5:0/1510236025 reap_dead start 2023-11-24T07:56:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f9de6859640 1 -- 172.21.15.5:0/1510236025 shutdown_connections 2023-11-24T07:56:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f9de6859640 1 -- 172.21.15.5:0/1510236025 >> 172.21.15.5:0/1510236025 conn(0x7f9de00666a0 msgr2=0x7f9de0066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f9de6859640 1 -- 172.21.15.5:0/1510236025 shutdown_connections 2023-11-24T07:56:57.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.987+0000 7f9de6859640 1 -- 172.21.15.5:0/1510236025 wait complete. 2023-11-24T07:56:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 0x7f3c8817cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c8817e630 0x7f3c8818ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c95e45640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 0x7f3c8817cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c95e45640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 0x7f3c8817cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:45222/0 (socket says 172.21.15.5:45222) 2023-11-24T07:56:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 0x7f3c880d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:57.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8818d200 con 0x7f3c8817e630 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8817e1a0 con 0x7f3c880df260 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96e47640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8817d590 con 0x7f3c8802e530 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c95e45640 1 -- 172.21.15.5:0/3336425545 learned_addr learned my addr 172.21.15.5:0/3336425545 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 0x7f3c880d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 -- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 msgr2=0x7f3c8817cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 0x7f3c8817cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 -- 172.21.15.5:0/3336425545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c8817e630 msgr2=0x7f3c8818ccc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c8817e630 0x7f3c8818ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:57.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 -- 172.21.15.5:0/3336425545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8817d870 con 0x7f3c8802e530 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.991+0000 7f3c96646640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 0x7f3c880d0720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c9004f6a0 tx=0x7f3c90068000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9004e9d0 con 0x7f3c8802e530 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c90071040 con 0x7f3c8802e530 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c90072490 con 0x7f3c8802e530 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8817db50 con 0x7f3c8802e530 2023-11-24T07:56:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8802e9b0 con 0x7f3c8802e530 2023-11-24T07:56:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8802ec60 con 0x7f3c8802e530 2023-11-24T07:56:57.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f9de6859640 1 Processor -- start 2023-11-24T07:56:57.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.995+0000 7f9de6859640 1 -- start start 2023-11-24T07:56:58.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 0x7f9de00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de00cbd40 0x7f9de00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de5857640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 0x7f9de00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c900725f0 con 0x7f3c8802e530 2023-11-24T07:56:58.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f3c867fc640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 0x7f3c74068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c900fde20 con 0x7f3c8802e530 2023-11-24T07:56:58.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de5857640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 0x7f9de00c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45702/0 (socket says 172.21.15.5:45702) 2023-11-24T07:56:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f3c95e45640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 0x7f3c74068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de5056640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de00cbd40 0x7f9de00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de5857640 1 -- 172.21.15.5:0/3756938064 learned_addr learned my addr 172.21.15.5:0/3756938064 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 0x7f9de00c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00cc240 con 0x7f9de00cbd40 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00cc520 con 0x7f9de00c6840 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:57.999+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00cc800 con 0x7f9de00c6460 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 0x7f9de00c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 -- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 msgr2=0x7f9de00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 0x7f9de00c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 -- 172.21.15.5:0/3756938064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de00cbd40 msgr2=0x7f9de00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de00cbd40 0x7f9de00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00ccae0 con 0x7f9de00c6840 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c900cb410 con 0x7f3c8802e530 2023-11-24T07:56:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f3c95e45640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 0x7f3c74068980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0047c0 tx=0x7f3c8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6058640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 0x7f9de00c6d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9de00d2c20 tx=0x7f9ddc010b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc00e840 con 0x7f9de00c6840 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc00e9a0 con 0x7f9de00c6840 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc00ed10 con 0x7f9de00c6840 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00ccdc0 con 0x7f9de00c6840 2023-11-24T07:56:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.003+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00b59a0 con 0x7f9de00c6840 2023-11-24T07:56:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.007+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de00ccfb0 con 0x7f9de00c6840 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.011+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ddc021460 con 0x7f9de00c6840 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.015+0000 7f9dd67fc640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 0x7f9dc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.015+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ddc083b70 con 0x7f9de00c6840 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.015+0000 7f9de5857640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 0x7f9dc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.015+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ddc0872a0 con 0x7f9de00c6840 2023-11-24T07:56:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.015+0000 7f9de5857640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 0x7f9dc4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009fb0 tx=0x7f9dd800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.039+0000 7f6523059640 1 Processor -- start 2023-11-24T07:56:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.039+0000 7f6523059640 1 -- start start 2023-11-24T07:56:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6523059640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f651c06dfb0 0x7f651c08a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6523059640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c16a040 0x7f651c08a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6523059640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c08add0 con 0x7f651c169c60 2023-11-24T07:56:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6523059640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c071c30 con 0x7f651c06dfb0 2023-11-24T07:56:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6523059640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c071290 con 0x7f651c16a040 2023-11-24T07:56:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f651c06dfb0 0x7f651c08a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f651c06dfb0 0x7f651c08a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57416/0 (socket says 172.21.15.5:57416) 2023-11-24T07:56:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 -- 172.21.15.5:0/726227831 learned_addr learned my addr 172.21.15.5:0/726227831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6522858640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c16a040 0x7f651c08a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 -- 172.21.15.5:0/726227831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c16a040 msgr2=0x7f651c08a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c16a040 0x7f651c08a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 -- 172.21.15.5:0/726227831 >> v1:172.21.15.102:6789/0 conn(0x7f651c169c60 legacy=0x7f651c06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.043+0000 7f6521856640 1 -- 172.21.15.5:0/726227831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c071570 con 0x7f651c06dfb0 2023-11-24T07:56:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6521856640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c08a350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a75d6fe734be05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6521055640 1 -- 172.21.15.5:0/726227831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180ac600 con 0x7f651c06dfb0 2023-11-24T07:56:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6521055640 1 -- 172.21.15.5:0/726227831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65180a8050 con 0x7f651c06dfb0 2023-11-24T07:56:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6521055640 1 -- 172.21.15.5:0/726227831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180ac980 con 0x7f651c06dfb0 2023-11-24T07:56:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 -- 172.21.15.5:0/726227831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 msgr2=0x7f651c08a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c08a350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651801c4d0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 -- 172.21.15.5:0/726227831 shutdown_connections 2023-11-24T07:56:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c16a040 0x7f651c08a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 --2- 172.21.15.5:0/726227831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c08a350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 -- 172.21.15.5:0/726227831 >> 172.21.15.5:0/726227831 conn(0x7f651c0b0c20 msgr2=0x7f651c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.051+0000 7f6523059640 1 -- 172.21.15.5:0/726227831 shutdown_connections 2023-11-24T07:56:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.055+0000 7f6523059640 1 -- 172.21.15.5:0/726227831 wait complete. 2023-11-24T07:56:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.055+0000 7f6523059640 1 Processor -- start 2023-11-24T07:56:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.055+0000 7f6523059640 1 -- start start 2023-11-24T07:56:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c1653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 0x7f651c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f651c16a040 0x7f651c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c164300 con 0x7f651c06dfb0 2023-11-24T07:56:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c1645e0 con 0x7f651c16a040 2023-11-24T07:56:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6521856640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 0x7f651c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6521856640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 0x7f651c15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45720/0 (socket says 172.21.15.5:45720) 2023-11-24T07:56:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6521856640 1 -- 172.21.15.5:0/3069413940 learned_addr learned my addr 172.21.15.5:0/3069413940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c1648c0 con 0x7f651c169c60 2023-11-24T07:56:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.059+0000 7f6522057640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c1653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 -- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 msgr2=0x7f651c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 0x7f651c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 -- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f651c16a040 msgr2=0x7f651c15d580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T07:56:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f651c16a040 0x7f651c15d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180094d0 con 0x7f651c06dfb0 2023-11-24T07:56:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6522057640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c1653a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b780 tx=0x7f650c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c00c720 con 0x7f651c06dfb0 2023-11-24T07:56:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.063+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c164ba0 con 0x7f651c06dfb0 2023-11-24T07:56:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.067+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c1658e0 con 0x7f651c06dfb0 2023-11-24T07:56:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.067+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c00c880 con 0x7f651c06dfb0 2023-11-24T07:56:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.067+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c00c720 con 0x7f651c06dfb0 2023-11-24T07:56:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.071+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504005260 con 0x7f651c06dfb0 2023-11-24T07:56:58.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.079+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f650c00ca70 con 0x7f651c06dfb0 2023-11-24T07:56:58.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.079+0000 7f6512ffd640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 0x7f6500068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.079+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f650c0830d0 con 0x7f651c06dfb0 2023-11-24T07:56:58.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.079+0000 7f6521856640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 0x7f6500068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.079+0000 7f6521856640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 0x7f6500068990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f65180a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.083+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f650c050560 con 0x7f651c06dfb0 2023-11-24T07:56:58.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.183+0000 7fcea211e640 1 -- 172.21.15.5:0/4132680817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce7c0057e0 con 0x7fce9c155130 2023-11-24T07:56:58.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.183+0000 7fce91ffb640 1 -- 172.21.15.5:0/4132680817 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce8c053c00 con 0x7fce9c155130 2023-11-24T07:56:58.188 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 msgr2=0x7fce80068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 0x7fce80068990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b0420 tx=0x7fce98008040 comp rx=0 tx=0).stop 2023-11-24T07:56:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 msgr2=0x7fce9c0af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b1b90 tx=0x7fce8c010f20 comp rx=0 tx=0).stop 2023-11-24T07:56:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 shutdown_connections 2023-11-24T07:56:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce800664d0 0x7fce80068990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce9c155130 0x7fce9c0af790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce9c203bb0 0x7fce9c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 --2- 172.21.15.5:0/4132680817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fce88008be0 0x7fce9c1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 >> 172.21.15.5:0/4132680817 conn(0x7fce9c0b0c20 msgr2=0x7fce9c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 shutdown_connections 2023-11-24T07:56:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.191+0000 7fce877fe640 1 -- 172.21.15.5:0/4132680817 wait complete. 2023-11-24T07:56:58.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2023-11-24T07:56:58.226 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.247+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5cb80057e0 con 0x7f5cd815cc80 2023-11-24T07:56:58.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.251+0000 7f5cd4ff9640 1 -- 172.21.15.5:0/2814386993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5cc8017020 con 0x7f5cd815cc80 2023-11-24T07:56:58.254 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:58.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe3e40057e0 con 0x7fe3f4005190 2023-11-24T07:56:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 msgr2=0x7f5cc4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 0x7f5cc4068990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0002240 tx=0x7f5cd0001ff0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 msgr2=0x7f5cd815ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 0x7f5cd815ad60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800e7f0 tx=0x7f5cc800ecb0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 shutdown_connections 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5cc40664d0 0x7f5cc4068990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cd815cc80 0x7f5cd815ad60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cd80b1fb0 0x7f5cd815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 --2- 172.21.15.5:0/2814386993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cd8072280 0x7f5cd8151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 >> 172.21.15.5:0/2814386993 conn(0x7f5cd80b0cb0 msgr2=0x7f5cd80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7fe3feffd640 1 -- 172.21.15.5:0/3778279009 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe404023070 con 0x7fe3f4005190 2023-11-24T07:56:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 shutdown_connections 2023-11-24T07:56:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.255+0000 7f5cde372640 1 -- 172.21.15.5:0/2814386993 wait complete. 2023-11-24T07:56:58.259 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 msgr2=0x7fe3ec068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 0x7fe3ec068980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8007fd0 tx=0x7fe3f8009040 comp rx=0 tx=0).stop 2023-11-24T07:56:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 msgr2=0x7fe40017db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe404009220 tx=0x7fe404011a40 comp rx=0 tx=0).stop 2023-11-24T07:56:58.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 shutdown_connections 2023-11-24T07:56:58.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe3ec0664c0 0x7fe3ec068980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe40004e970 0x7fe4000de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe40004e4f0 0x7fe400176f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 --2- 172.21.15.5:0/3778279009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3f4005190 0x7fe40017db60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.259+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 >> 172.21.15.5:0/3778279009 conn(0x7fe400009f90 msgr2=0x7fe4000349e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 shutdown_connections 2023-11-24T07:56:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7fe3fcff9640 1 -- 172.21.15.5:0/3778279009 wait complete. 2023-11-24T07:56:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f16c4140a80 con 0x7f16c40b4690 2023-11-24T07:56:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f78fc005510 con 0x7f79140b46b0 2023-11-24T07:56:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7f16b6ffd640 1 -- 172.21.15.5:0/2893686263 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16c4140a80 con 0x7f16c40b4690 2023-11-24T07:56:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.263+0000 7f790affd640 1 -- 172.21.15.5:0/2106208370 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7904021070 con 0x7f79140b46b0 2023-11-24T07:56:58.268 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-11-24T07:56:58.270 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 msgr2=0x7f16a8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 0x7f16a8068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001770 tx=0x7f16b80016c0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 msgr2=0x7f16c414d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e8a0 tx=0x7f16c000ed60 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 shutdown_connections 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f16a80664c0 0x7f16a8068980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16c4162960 0x7f16c4143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40b4690 0x7f16c414d720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 --2- 172.21.15.5:0/2893686263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c40b25d0 0x7f16c4163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 >> 172.21.15.5:0/2893686263 conn(0x7f16c406c340 msgr2=0x7f16c40af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 shutdown_connections 2023-11-24T07:56:58.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.267+0000 7f16cc73e640 1 -- 172.21.15.5:0/2893686263 wait complete. 2023-11-24T07:56:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 msgr2=0x7f78f8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 0x7f78f8068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f790c007fd0 tx=0x7f790c007d60 comp rx=0 tx=0).stop 2023-11-24T07:56:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 msgr2=0x7f791414ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f790400e930 tx=0x7f790400edf0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 shutdown_connections 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f78f8066540 0x7f78f8068a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f791414b320 0x7f79141491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f791414af40 0x7f79141687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 --2- 172.21.15.5:0/2106208370 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79140b46b0 0x7f791414ba80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.271+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 >> 172.21.15.5:0/2106208370 conn(0x7f79140b0d90 msgr2=0x7f7914144360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.275+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 shutdown_connections 2023-11-24T07:56:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.275+0000 7f791c646640 1 -- 172.21.15.5:0/2106208370 wait complete. 2023-11-24T07:56:58.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-11-24T07:56:58.293 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-11-24T07:56:58.300 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-11-24T07:56:58.304 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.307+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9de00cc660 con 0x7f9de00c6840 2023-11-24T07:56:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.307+0000 7f9dd67fc640 1 -- 172.21.15.5:0/3756938064 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9de00cc660 con 0x7f9de00c6840 2023-11-24T07:56:58.311 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-11-24T07:56:58.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-11-24T07:56:58.313 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 msgr2=0x7f9dc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 0x7f9dc4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009fb0 tx=0x7f9dd800b040 comp rx=0 tx=0).stop 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 msgr2=0x7f9de00c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 0x7f9de00c6d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9de00d2c20 tx=0x7f9ddc010b60 comp rx=0 tx=0).stop 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 shutdown_connections 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc40664a0 0x7f9dc4068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de00c6840 0x7f9de00c6d40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de00cbd40 0x7f9de00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 --2- 172.21.15.5:0/3756938064 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de00c6460 0x7f9de00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 >> 172.21.15.5:0/3756938064 conn(0x7f9de00666a0 msgr2=0x7f9de015c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 shutdown_connections 2023-11-24T07:56:58.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.311+0000 7f9de6859640 1 -- 172.21.15.5:0/3756938064 wait complete. 2023-11-24T07:56:58.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c8802ec60 con 0x7f3c8802e530 2023-11-24T07:56:58.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c867fc640 1 -- 172.21.15.5:0/3336425545 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c8802ec60 con 0x7f3c8802e530 2023-11-24T07:56:58.322 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-24T07:56:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 msgr2=0x7f3c74068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 0x7f3c74068980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0047c0 tx=0x7f3c8c008040 comp rx=0 tx=0).stop 2023-11-24T07:56:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 msgr2=0x7f3c880d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 0x7f3c880d0720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c9004f6a0 tx=0x7f3c90068000 comp rx=0 tx=0).stop 2023-11-24T07:56:58.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 shutdown_connections 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3c740664c0 0x7f3c74068980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3c8802e530 0x7f3c880d0720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c8817e630 0x7f3c8818ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 --2- 172.21.15.5:0/3336425545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c880df260 0x7f3c8817cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 >> 172.21.15.5:0/3336425545 conn(0x7f3c88009f90 msgr2=0x7f3c880534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 shutdown_connections 2023-11-24T07:56:58.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.319+0000 7f3c96e47640 1 -- 172.21.15.5:0/3336425545 wait complete. 2023-11-24T07:56:58.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-11-24T07:56:58.334 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-11-24T07:56:58.344 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6504005510 con 0x7f651c06dfb0 2023-11-24T07:56:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6512ffd640 1 -- 172.21.15.5:0/3069413940 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f650c053b80 con 0x7f651c06dfb0 2023-11-24T07:56:58.358 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-11-24T07:56:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 msgr2=0x7f6500068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 0x7f6500068990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f65180a7000 comp rx=0 tx=0).stop 2023-11-24T07:56:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 msgr2=0x7f651c1653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c1653a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b780 tx=0x7f650c00bc40 comp rx=0 tx=0).stop 2023-11-24T07:56:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 shutdown_connections 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f65000664d0 0x7f6500068990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f651c16a040 0x7f651c15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f651c169c60 0x7f651c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 --2- 172.21.15.5:0/3069413940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f651c06dfb0 0x7f651c1653a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 >> 172.21.15.5:0/3069413940 conn(0x7f651c0b0c20 msgr2=0x7f651c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 shutdown_connections 2023-11-24T07:56:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.355+0000 7f6523059640 1 -- 172.21.15.5:0/3069413940 wait complete. 2023-11-24T07:56:58.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-11-24T07:56:58.379 DEBUG:teuthology.parallel:result is None 2023-11-24T07:56:58.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T07:56:58.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:56:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.559+0000 7f3764ff8640 1 Processor -- start 2023-11-24T07:56:58.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.559+0000 7f3764ff8640 1 -- start start 2023-11-24T07:56:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3764ff8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3764ff8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3760070c20 0x7f376006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3764ff8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3760145060 con 0x7f3760144c80 2023-11-24T07:56:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3764ff8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3760071fd0 con 0x7f3760070c20 2023-11-24T07:56:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3764ff8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3760071450 con 0x7f37600ac630 2023-11-24T07:56:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3757fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3757fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45734/0 (socket says 172.21.15.5:45734) 2023-11-24T07:56:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3757fff640 1 -- 172.21.15.5:0/1680235469 learned_addr learned my addr 172.21.15.5:0/1680235469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375e59c640 1 --1- 172.21.15.5:0/1680235469 >> v1:172.21.15.102:6789/0 conn(0x7f3760144c80 0x7f37600abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:53770/0 (socket says 172.21.15.5:53770) 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375ed9d640 1 --2- 172.21.15.5:0/1680235469 >> v2:172.21.15.102:3300/0 conn(0x7f3760070c20 0x7f376006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375dd9b640 1 -- 172.21.15.5:0/1680235469 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648623533 0 0) 0x7f3760145060 con 0x7f3760144c80 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375dd9b640 1 -- 172.21.15.5:0/1680235469 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f374c003530 con 0x7f3760144c80 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375ed9d640 1 -- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 msgr2=0x7f37600706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375ed9d640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375ed9d640 1 -- 172.21.15.5:0/1680235469 >> v1:172.21.15.102:6789/0 conn(0x7f3760144c80 legacy=0x7f37600abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f375ed9d640 1 -- 172.21.15.5:0/1680235469 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760071730 con 0x7f3760070c20 2023-11-24T07:56:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.563+0000 7f3757fff640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:56:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f375ed9d640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760070c20 0x7f376006c910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3758009d90 tx=0x7f375801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a96356fccff7cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f375dd9b640 1 -- 172.21.15.5:0/1680235469 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580a59e0 con 0x7f3760070c20 2023-11-24T07:56:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f375dd9b640 1 -- 172.21.15.5:0/1680235469 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37580a5b40 con 0x7f3760070c20 2023-11-24T07:56:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f375dd9b640 1 -- 172.21.15.5:0/1680235469 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580ad440 con 0x7f3760070c20 2023-11-24T07:56:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760070c20 msgr2=0x7f376006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760070c20 0x7f376006c910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3758009d90 tx=0x7f375801c920 comp rx=0 tx=0).stop 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- 172.21.15.5:0/1680235469 shutdown_connections 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760070c20 0x7f376006c910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 --2- 172.21.15.5:0/1680235469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f37600706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- 172.21.15.5:0/1680235469 >> 172.21.15.5:0/1680235469 conn(0x7f37600b0c40 msgr2=0x7f37600b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- 172.21.15.5:0/1680235469 shutdown_connections 2023-11-24T07:56:58.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- 172.21.15.5:0/1680235469 wait complete. 2023-11-24T07:56:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 Processor -- start 2023-11-24T07:56:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.567+0000 7f3764ff8640 1 -- start start 2023-11-24T07:56:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f3760154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 0x7f3760154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760139e60 con 0x7f3760070c20 2023-11-24T07:56:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376013a880 con 0x7f3760144c80 2023-11-24T07:56:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37601391e0 con 0x7f37600ac630 2023-11-24T07:56:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57432/0 (socket says 172.21.15.5:57432) 2023-11-24T07:56:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 -- 172.21.15.5:0/3019484686 learned_addr learned my addr 172.21.15.5:0/3019484686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3757fff640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f3760154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375ed9d640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 0x7f3760154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 -- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 msgr2=0x7f3760154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f3760154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 -- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 msgr2=0x7f3760154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 0x7f3760154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 -- 172.21.15.5:0/3019484686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480094d0 con 0x7f3760070c20 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3757fff640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f3760154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375ed9d640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 0x7f3760154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f375e59c640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f375000c4d0 tx=0x7f375000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750007480 con 0x7f3760070c20 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500075e0 con 0x7f3760070c20 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750004a30 con 0x7f3760070c20 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3758009a70 con 0x7f3760070c20 2023-11-24T07:56:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37601397a0 con 0x7f3760070c20 2023-11-24T07:56:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.571+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37600b1ba0 con 0x7f3760070c20 2023-11-24T07:56:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.575+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3750004b90 con 0x7f3760070c20 2023-11-24T07:56:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.575+0000 7f3756ffd640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 0x7f3740068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.575+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3750082fe0 con 0x7f3760070c20 2023-11-24T07:56:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.575+0000 7f3757fff640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 0x7f3740068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.575+0000 7f3757fff640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 0x7f3740068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f376013dff0 tx=0x7f3748008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.579+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37500504b0 con 0x7f3760070c20 2023-11-24T07:56:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.731+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3760139fa0 con 0x7f37400664a0 2023-11-24T07:56:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.739+0000 7f3756ffd640 1 -- 172.21.15.5:0/3019484686 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264627 (secure 0 0 0) 0x7f3760139fa0 con 0x7f37400664a0 2023-11-24T07:56:58.746 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:58.748 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 msgr2=0x7f3740068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 0x7f3740068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f376013dff0 tx=0x7f3748008040 comp rx=0 tx=0).stop 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 msgr2=0x7f3760138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f375000c4d0 tx=0x7f375000c990 comp rx=0 tx=0).stop 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 shutdown_connections 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37400664a0 0x7f3740068960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3760144c80 0x7f3760154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37600ac630 0x7f3760154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 --2- 172.21.15.5:0/3019484686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760070c20 0x7f3760138770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 >> 172.21.15.5:0/3019484686 conn(0x7f37600b0c40 msgr2=0x7f37600b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 shutdown_connections 2023-11-24T07:56:58.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.743+0000 7f3764ff8640 1 -- 172.21.15.5:0/3019484686 wait complete. 2023-11-24T07:56:58.767 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T07:56:57.237365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235644,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739076,"statfs":{"total":773094113280,"available":772852813824,"internally_reserved":0,"allocated":2875392,"data_stored":1748760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988313+0000","last_change":"2023-11-24T07:56:50.004858+0000","last_active":"2023-11-24T07:56:50.988313+0000","last_peered":"2023-11-24T07:56:50.988313+0000","last_clean":"2023-11-24T07:56:50.988313+0000","last_became_active":"2023-11-24T07:56:49.993400+0000","last_became_peered":"2023-11-24T07:56:49.993400+0000","last_unstale":"2023-11-24T07:56:50.988313+0000","last_undegraded":"2023-11-24T07:56:50.988313+0000","last_fullsized":"2023-11-24T07:56:50.988313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:57.211418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452806+0000","last_change":"2023-11-24T07:56:49.991230+0000","last_active":"2023-11-24T07:56:51.452806+0000","last_peered":"2023-11-24T07:56:51.452806+0000","last_clean":"2023-11-24T07:56:51.452806+0000","last_became_active":"2023-11-24T07:56:49.990940+0000","last_became_peered":"2023-11-24T07:56:49.990940+0000","last_unstale":"2023-11-24T07:56:51.452806+0000","last_undegraded":"2023-11-24T07:56:51.452806+0000","last_fullsized":"2023-11-24T07:56:51.452806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769873+0000","last_change":"2023-11-24T07:56:49.989286+0000","last_active":"2023-11-24T07:56:51.769873+0000","last_peered":"2023-11-24T07:56:51.769873+0000","last_clean":"2023-11-24T07:56:51.769873+0000","last_became_active":"2023-11-24T07:56:49.988948+0000","last_became_peered":"2023-11-24T07:56:49.988948+0000","last_unstale":"2023-11-24T07:56:51.769873+0000","last_undegraded":"2023-11-24T07:56:51.769873+0000","last_fullsized":"2023-11-24T07:56:51.769873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466062+0000","last_change":"2023-11-24T07:56:49.994907+0000","last_active":"2023-11-24T07:56:51.466062+0000","last_peered":"2023-11-24T07:56:51.466062+0000","last_clean":"2023-11-24T07:56:51.466062+0000","last_became_active":"2023-11-24T07:56:49.994332+0000","last_became_peered":"2023-11-24T07:56:49.994332+0000","last_unstale":"2023-11-24T07:56:51.466062+0000","last_undegraded":"2023-11-24T07:56:51.466062+0000","last_fullsized":"2023-11-24T07:56:51.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987792+0000","last_change":"2023-11-24T07:56:49.998831+0000","last_active":"2023-11-24T07:56:50.987792+0000","last_peered":"2023-11-24T07:56:50.987792+0000","last_clean":"2023-11-24T07:56:50.987792+0000","last_became_active":"2023-11-24T07:56:49.991235+0000","last_became_peered":"2023-11-24T07:56:49.991235+0000","last_unstale":"2023-11-24T07:56:50.987792+0000","last_undegraded":"2023-11-24T07:56:50.987792+0000","last_fullsized":"2023-11-24T07:56:50.987792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465842+0000","last_change":"2023-11-24T07:56:50.008660+0000","last_active":"2023-11-24T07:56:51.465842+0000","last_peered":"2023-11-24T07:56:51.465842+0000","last_clean":"2023-11-24T07:56:51.465842+0000","last_became_active":"2023-11-24T07:56:50.008297+0000","last_became_peered":"2023-11-24T07:56:50.008297+0000","last_unstale":"2023-11-24T07:56:51.465842+0000","last_undegraded":"2023-11-24T07:56:51.465842+0000","last_fullsized":"2023-11-24T07:56:51.465842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987569+0000","last_change":"2023-11-24T07:56:49.999624+0000","last_active":"2023-11-24T07:56:50.987569+0000","last_peered":"2023-11-24T07:56:50.987569+0000","last_clean":"2023-11-24T07:56:50.987569+0000","last_became_active":"2023-11-24T07:56:49.999370+0000","last_became_peered":"2023-11-24T07:56:49.999370+0000","last_unstale":"2023-11-24T07:56:50.987569+0000","last_undegraded":"2023-11-24T07:56:50.987569+0000","last_fullsized":"2023-11-24T07:56:50.987569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988066+0000","last_change":"2023-11-24T07:56:49.999092+0000","last_active":"2023-11-24T07:56:50.988066+0000","last_peered":"2023-11-24T07:56:50.988066+0000","last_clean":"2023-11-24T07:56:50.988066+0000","last_became_active":"2023-11-24T07:56:49.998578+0000","last_became_peered":"2023-11-24T07:56:49.998578+0000","last_unstale":"2023-11-24T07:56:50.988066+0000","last_undegraded":"2023-11-24T07:56:50.988066+0000","last_fullsized":"2023-11-24T07:56:50.988066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988332+0000","last_change":"2023-11-24T07:56:50.016980+0000","last_active":"2023-11-24T07:56:50.988332+0000","last_peered":"2023-11-24T07:56:50.988332+0000","last_clean":"2023-11-24T07:56:50.988332+0000","last_became_active":"2023-11-24T07:56:50.016704+0000","last_became_peered":"2023-11-24T07:56:50.016704+0000","last_unstale":"2023-11-24T07:56:50.988332+0000","last_undegraded":"2023-11-24T07:56:50.988332+0000","last_fullsized":"2023-11-24T07:56:50.988332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:13.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767300+0000","last_change":"2023-11-24T07:56:50.010849+0000","last_active":"2023-11-24T07:56:51.767300+0000","last_peered":"2023-11-24T07:56:51.767300+0000","last_clean":"2023-11-24T07:56:51.767300+0000","last_became_active":"2023-11-24T07:56:50.010479+0000","last_became_peered":"2023-11-24T07:56:50.010479+0000","last_unstale":"2023-11-24T07:56:51.767300+0000","last_undegraded":"2023-11-24T07:56:51.767300+0000","last_fullsized":"2023-11-24T07:56:51.767300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767408+0000","last_change":"2023-11-24T07:56:50.016938+0000","last_active":"2023-11-24T07:56:51.767408+0000","last_peered":"2023-11-24T07:56:51.767408+0000","last_clean":"2023-11-24T07:56:51.767408+0000","last_became_active":"2023-11-24T07:56:50.016537+0000","last_became_peered":"2023-11-24T07:56:50.016537+0000","last_unstale":"2023-11-24T07:56:51.767408+0000","last_undegraded":"2023-11-24T07:56:51.767408+0000","last_fullsized":"2023-11-24T07:56:51.767408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986876+0000","last_change":"2023-11-24T07:56:49.989957+0000","last_active":"2023-11-24T07:56:50.986876+0000","last_peered":"2023-11-24T07:56:50.986876+0000","last_clean":"2023-11-24T07:56:50.986876+0000","last_became_active":"2023-11-24T07:56:49.989604+0000","last_became_peered":"2023-11-24T07:56:49.989604+0000","last_unstale":"2023-11-24T07:56:50.986876+0000","last_undegraded":"2023-11-24T07:56:50.986876+0000","last_fullsized":"2023-11-24T07:56:50.986876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988569+0000","last_change":"2023-11-24T07:56:49.988221+0000","last_active":"2023-11-24T07:56:50.988569+0000","last_peered":"2023-11-24T07:56:50.988569+0000","last_clean":"2023-11-24T07:56:50.988569+0000","last_became_active":"2023-11-24T07:56:49.987909+0000","last_became_peered":"2023-11-24T07:56:49.987909+0000","last_unstale":"2023-11-24T07:56:50.988569+0000","last_undegraded":"2023-11-24T07:56:50.988569+0000","last_fullsized":"2023-11-24T07:56:50.988569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769607+0000","last_change":"2023-11-24T07:56:49.987632+0000","last_active":"2023-11-24T07:56:51.769607+0000","last_peered":"2023-11-24T07:56:51.769607+0000","last_clean":"2023-11-24T07:56:51.769607+0000","last_became_active":"2023-11-24T07:56:49.983904+0000","last_became_peered":"2023-11-24T07:56:49.983904+0000","last_unstale":"2023-11-24T07:56:51.769607+0000","last_undegraded":"2023-11-24T07:56:51.769607+0000","last_fullsized":"2023-11-24T07:56:51.769607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452591+0000","last_change":"2023-11-24T07:56:49.993099+0000","last_active":"2023-11-24T07:56:51.452591+0000","last_peered":"2023-11-24T07:56:51.452591+0000","last_clean":"2023-11-24T07:56:51.452591+0000","last_became_active":"2023-11-24T07:56:49.992805+0000","last_became_peered":"2023-11-24T07:56:49.992805+0000","last_unstale":"2023-11-24T07:56:51.452591+0000","last_undegraded":"2023-11-24T07:56:51.452591+0000","last_fullsized":"2023-11-24T07:56:51.452591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465851+0000","last_change":"2023-11-24T07:56:49.996222+0000","last_active":"2023-11-24T07:56:51.465851+0000","last_peered":"2023-11-24T07:56:51.465851+0000","last_clean":"2023-11-24T07:56:51.465851+0000","last_became_active":"2023-11-24T07:56:49.995849+0000","last_became_peered":"2023-11-24T07:56:49.995849+0000","last_unstale":"2023-11-24T07:56:51.465851+0000","last_undegraded":"2023-11-24T07:56:51.465851+0000","last_fullsized":"2023-11-24T07:56:51.465851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466448+0000","last_change":"2023-11-24T07:56:50.016330+0000","last_active":"2023-11-24T07:56:51.466448+0000","last_peered":"2023-11-24T07:56:51.466448+0000","last_clean":"2023-11-24T07:56:51.466448+0000","last_became_active":"2023-11-24T07:56:50.016061+0000","last_became_peered":"2023-11-24T07:56:50.016061+0000","last_unstale":"2023-11-24T07:56:51.466448+0000","last_undegraded":"2023-11-24T07:56:51.466448+0000","last_fullsized":"2023-11-24T07:56:51.466448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.711313+0000","last_change":"2023-11-24T07:56:49.995710+0000","last_active":"2023-11-24T07:56:51.711313+0000","last_peered":"2023-11-24T07:56:51.711313+0000","last_clean":"2023-11-24T07:56:51.711313+0000","last_became_active":"2023-11-24T07:56:49.995395+0000","last_became_peered":"2023-11-24T07:56:49.995395+0000","last_unstale":"2023-11-24T07:56:51.711313+0000","last_undegraded":"2023-11-24T07:56:51.711313+0000","last_fullsized":"2023-11-24T07:56:51.711313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:09.056215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988254+0000","last_change":"2023-11-24T07:56:49.987938+0000","last_active":"2023-11-24T07:56:50.988254+0000","last_peered":"2023-11-24T07:56:50.988254+0000","last_clean":"2023-11-24T07:56:50.988254+0000","last_became_active":"2023-11-24T07:56:49.987515+0000","last_became_peered":"2023-11-24T07:56:49.987515+0000","last_unstale":"2023-11-24T07:56:50.988254+0000","last_undegraded":"2023-11-24T07:56:50.988254+0000","last_fullsized":"2023-11-24T07:56:50.988254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767141+0000","last_change":"2023-11-24T07:56:49.994082+0000","last_active":"2023-11-24T07:56:51.767141+0000","last_peered":"2023-11-24T07:56:51.767141+0000","last_clean":"2023-11-24T07:56:51.767141+0000","last_became_active":"2023-11-24T07:56:49.993509+0000","last_became_peered":"2023-11-24T07:56:49.993509+0000","last_unstale":"2023-11-24T07:56:51.767141+0000","last_undegraded":"2023-11-24T07:56:51.767141+0000","last_fullsized":"2023-11-24T07:56:51.767141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769687+0000","last_change":"2023-11-24T07:56:49.981227+0000","last_active":"2023-11-24T07:56:51.769687+0000","last_peered":"2023-11-24T07:56:51.769687+0000","last_clean":"2023-11-24T07:56:51.769687+0000","last_became_active":"2023-11-24T07:56:49.980964+0000","last_became_peered":"2023-11-24T07:56:49.980964+0000","last_unstale":"2023-11-24T07:56:51.769687+0000","last_undegraded":"2023-11-24T07:56:51.769687+0000","last_fullsized":"2023-11-24T07:56:51.769687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:12.475852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465915+0000","last_change":"2023-11-24T07:56:50.009118+0000","last_active":"2023-11-24T07:56:51.465915+0000","last_peered":"2023-11-24T07:56:51.465915+0000","last_clean":"2023-11-24T07:56:51.465915+0000","last_became_active":"2023-11-24T07:56:50.008914+0000","last_became_peered":"2023-11-24T07:56:50.008914+0000","last_unstale":"2023-11-24T07:56:51.465915+0000","last_undegraded":"2023-11-24T07:56:51.465915+0000","last_fullsized":"2023-11-24T07:56:51.465915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988096+0000","last_change":"2023-11-24T07:56:49.993617+0000","last_active":"2023-11-24T07:56:50.988096+0000","last_peered":"2023-11-24T07:56:50.988096+0000","last_clean":"2023-11-24T07:56:50.988096+0000","last_became_active":"2023-11-24T07:56:49.993342+0000","last_became_peered":"2023-11-24T07:56:49.993342+0000","last_unstale":"2023-11-24T07:56:50.988096+0000","last_undegraded":"2023-11-24T07:56:50.988096+0000","last_fullsized":"2023-11-24T07:56:50.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465971+0000","last_change":"2023-11-24T07:56:49.987374+0000","last_active":"2023-11-24T07:56:51.465971+0000","last_peered":"2023-11-24T07:56:51.465971+0000","last_clean":"2023-11-24T07:56:51.465971+0000","last_became_active":"2023-11-24T07:56:49.987072+0000","last_became_peered":"2023-11-24T07:56:49.987072+0000","last_unstale":"2023-11-24T07:56:51.465971+0000","last_undegraded":"2023-11-24T07:56:51.465971+0000","last_fullsized":"2023-11-24T07:56:51.465971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989129+0000","last_change":"2023-11-24T07:56:50.007415+0000","last_active":"2023-11-24T07:56:50.989129+0000","last_peered":"2023-11-24T07:56:50.989129+0000","last_clean":"2023-11-24T07:56:50.989129+0000","last_became_active":"2023-11-24T07:56:50.007143+0000","last_became_peered":"2023-11-24T07:56:50.007143+0000","last_unstale":"2023-11-24T07:56:50.989129+0000","last_undegraded":"2023-11-24T07:56:50.989129+0000","last_fullsized":"2023-11-24T07:56:50.989129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767307+0000","last_change":"2023-11-24T07:56:49.992073+0000","last_active":"2023-11-24T07:56:51.767307+0000","last_peered":"2023-11-24T07:56:51.767307+0000","last_clean":"2023-11-24T07:56:51.767307+0000","last_became_active":"2023-11-24T07:56:49.991751+0000","last_became_peered":"2023-11-24T07:56:49.991751+0000","last_unstale":"2023-11-24T07:56:51.767307+0000","last_undegraded":"2023-11-24T07:56:51.767307+0000","last_fullsized":"2023-11-24T07:56:51.767307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452672+0000","last_change":"2023-11-24T07:56:49.991019+0000","last_active":"2023-11-24T07:56:51.452672+0000","last_peered":"2023-11-24T07:56:51.452672+0000","last_clean":"2023-11-24T07:56:51.452672+0000","last_became_active":"2023-11-24T07:56:49.990710+0000","last_became_peered":"2023-11-24T07:56:49.990710+0000","last_unstale":"2023-11-24T07:56:51.452672+0000","last_undegraded":"2023-11-24T07:56:51.452672+0000","last_fullsized":"2023-11-24T07:56:51.452672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988686+0000","last_change":"2023-11-24T07:56:50.007449+0000","last_active":"2023-11-24T07:56:50.988686+0000","last_peered":"2023-11-24T07:56:50.988686+0000","last_clean":"2023-11-24T07:56:50.988686+0000","last_became_active":"2023-11-24T07:56:50.007205+0000","last_became_peered":"2023-11-24T07:56:50.007205+0000","last_unstale":"2023-11-24T07:56:50.988686+0000","last_undegraded":"2023-11-24T07:56:50.988686+0000","last_fullsized":"2023-11-24T07:56:50.988686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769776+0000","last_change":"2023-11-24T07:56:49.991939+0000","last_active":"2023-11-24T07:56:51.769776+0000","last_peered":"2023-11-24T07:56:51.769776+0000","last_clean":"2023-11-24T07:56:51.769776+0000","last_became_active":"2023-11-24T07:56:49.991553+0000","last_became_peered":"2023-11-24T07:56:49.991553+0000","last_unstale":"2023-11-24T07:56:51.769776+0000","last_undegraded":"2023-11-24T07:56:51.769776+0000","last_fullsized":"2023-11-24T07:56:51.769776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466033+0000","last_change":"2023-11-24T07:56:49.996135+0000","last_active":"2023-11-24T07:56:51.466033+0000","last_peered":"2023-11-24T07:56:51.466033+0000","last_clean":"2023-11-24T07:56:51.466033+0000","last_became_active":"2023-11-24T07:56:49.995502+0000","last_became_peered":"2023-11-24T07:56:49.995502+0000","last_unstale":"2023-11-24T07:56:51.466033+0000","last_undegraded":"2023-11-24T07:56:51.466033+0000","last_fullsized":"2023-11-24T07:56:51.466033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.711133+0000","last_change":"2023-11-24T07:56:49.999799+0000","last_active":"2023-11-24T07:56:51.711133+0000","last_peered":"2023-11-24T07:56:51.711133+0000","last_clean":"2023-11-24T07:56:51.711133+0000","last_became_active":"2023-11-24T07:56:49.999461+0000","last_became_peered":"2023-11-24T07:56:49.999461+0000","last_unstale":"2023-11-24T07:56:51.711133+0000","last_undegraded":"2023-11-24T07:56:51.711133+0000","last_fullsized":"2023-11-24T07:56:51.711133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:02.354677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.766985+0000","last_change":"2023-11-24T07:56:50.006284+0000","last_active":"2023-11-24T07:56:51.766985+0000","last_peered":"2023-11-24T07:56:51.766985+0000","last_clean":"2023-11-24T07:56:51.766985+0000","last_became_active":"2023-11-24T07:56:50.005181+0000","last_became_peered":"2023-11-24T07:56:50.005181+0000","last_unstale":"2023-11-24T07:56:51.766985+0000","last_undegraded":"2023-11-24T07:56:51.766985+0000","last_fullsized":"2023-11-24T07:56:51.766985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986518+0000","last_change":"2023-11-24T07:56:49.982685+0000","last_active":"2023-11-24T07:56:50.986518+0000","last_peered":"2023-11-24T07:56:50.986518+0000","last_clean":"2023-11-24T07:56:50.986518+0000","last_became_active":"2023-11-24T07:56:49.982396+0000","last_became_peered":"2023-11-24T07:56:49.982396+0000","last_unstale":"2023-11-24T07:56:50.986518+0000","last_undegraded":"2023-11-24T07:56:50.986518+0000","last_fullsized":"2023-11-24T07:56:50.986518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988660+0000","last_change":"2023-11-24T07:56:48.997228+0000","last_active":"2023-11-24T07:56:50.988660+0000","last_peered":"2023-11-24T07:56:50.988660+0000","last_clean":"2023-11-24T07:56:50.988660+0000","last_became_active":"2023-11-24T07:56:48.996544+0000","last_became_peered":"2023-11-24T07:56:48.996544+0000","last_unstale":"2023-11-24T07:56:50.988660+0000","last_undegraded":"2023-11-24T07:56:50.988660+0000","last_fullsized":"2023-11-24T07:56:50.988660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769843+0000","last_change":"2023-11-24T07:56:49.994392+0000","last_active":"2023-11-24T07:56:51.769843+0000","last_peered":"2023-11-24T07:56:51.769843+0000","last_clean":"2023-11-24T07:56:51.769843+0000","last_became_active":"2023-11-24T07:56:49.991942+0000","last_became_peered":"2023-11-24T07:56:49.991942+0000","last_unstale":"2023-11-24T07:56:51.769843+0000","last_undegraded":"2023-11-24T07:56:51.769843+0000","last_fullsized":"2023-11-24T07:56:51.769843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262002+0000","last_change":"2023-11-24T07:56:48.990750+0000","last_active":"2023-11-24T07:56:51.262002+0000","last_peered":"2023-11-24T07:56:51.262002+0000","last_clean":"2023-11-24T07:56:51.262002+0000","last_became_active":"2023-11-24T07:56:48.990336+0000","last_became_peered":"2023-11-24T07:56:48.990336+0000","last_unstale":"2023-11-24T07:56:51.262002+0000","last_undegraded":"2023-11-24T07:56:51.262002+0000","last_fullsized":"2023-11-24T07:56:51.262002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988186+0000","last_change":"2023-11-24T07:56:48.996558+0000","last_active":"2023-11-24T07:56:50.988186+0000","last_peered":"2023-11-24T07:56:50.988186+0000","last_clean":"2023-11-24T07:56:50.988186+0000","last_became_active":"2023-11-24T07:56:48.996277+0000","last_became_peered":"2023-11-24T07:56:48.996277+0000","last_unstale":"2023-11-24T07:56:50.988186+0000","last_undegraded":"2023-11-24T07:56:50.988186+0000","last_fullsized":"2023-11-24T07:56:50.988186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988149+0000","last_change":"2023-11-24T07:56:49.990169+0000","last_active":"2023-11-24T07:56:50.988149+0000","last_peered":"2023-11-24T07:56:50.988149+0000","last_clean":"2023-11-24T07:56:50.988149+0000","last_became_active":"2023-11-24T07:56:49.989887+0000","last_became_peered":"2023-11-24T07:56:49.989887+0000","last_unstale":"2023-11-24T07:56:50.988149+0000","last_undegraded":"2023-11-24T07:56:50.988149+0000","last_fullsized":"2023-11-24T07:56:50.988149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268528+0000","last_change":"2023-11-24T07:56:48.988849+0000","last_active":"2023-11-24T07:56:51.268528+0000","last_peered":"2023-11-24T07:56:51.268528+0000","last_clean":"2023-11-24T07:56:51.268528+0000","last_became_active":"2023-11-24T07:56:48.988481+0000","last_became_peered":"2023-11-24T07:56:48.988481+0000","last_unstale":"2023-11-24T07:56:51.268528+0000","last_undegraded":"2023-11-24T07:56:51.268528+0000","last_fullsized":"2023-11-24T07:56:51.268528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452600+0000","last_change":"2023-11-24T07:56:49.998134+0000","last_active":"2023-11-24T07:56:51.452600+0000","last_peered":"2023-11-24T07:56:51.452600+0000","last_clean":"2023-11-24T07:56:51.452600+0000","last_became_active":"2023-11-24T07:56:49.997733+0000","last_became_peered":"2023-11-24T07:56:49.997733+0000","last_unstale":"2023-11-24T07:56:51.452600+0000","last_undegraded":"2023-11-24T07:56:51.452600+0000","last_fullsized":"2023-11-24T07:56:51.452600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262127+0000","last_change":"2023-11-24T07:56:48.996333+0000","last_active":"2023-11-24T07:56:51.262127+0000","last_peered":"2023-11-24T07:56:51.262127+0000","last_clean":"2023-11-24T07:56:51.262127+0000","last_became_active":"2023-11-24T07:56:48.995991+0000","last_became_peered":"2023-11-24T07:56:48.995991+0000","last_unstale":"2023-11-24T07:56:51.262127+0000","last_undegraded":"2023-11-24T07:56:51.262127+0000","last_fullsized":"2023-11-24T07:56:51.262127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466407+0000","last_change":"2023-11-24T07:56:50.009044+0000","last_active":"2023-11-24T07:56:51.466407+0000","last_peered":"2023-11-24T07:56:51.466407+0000","last_clean":"2023-11-24T07:56:51.466407+0000","last_became_active":"2023-11-24T07:56:50.008572+0000","last_became_peered":"2023-11-24T07:56:50.008572+0000","last_unstale":"2023-11-24T07:56:51.466407+0000","last_undegraded":"2023-11-24T07:56:51.466407+0000","last_fullsized":"2023-11-24T07:56:51.466407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268746+0000","last_change":"2023-11-24T07:56:48.994794+0000","last_active":"2023-11-24T07:56:51.268746+0000","last_peered":"2023-11-24T07:56:51.268746+0000","last_clean":"2023-11-24T07:56:51.268746+0000","last_became_active":"2023-11-24T07:56:48.994353+0000","last_became_peered":"2023-11-24T07:56:48.994353+0000","last_unstale":"2023-11-24T07:56:51.268746+0000","last_undegraded":"2023-11-24T07:56:51.268746+0000","last_fullsized":"2023-11-24T07:56:51.268746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.770004+0000","last_change":"2023-11-24T07:56:49.999054+0000","last_active":"2023-11-24T07:56:51.770004+0000","last_peered":"2023-11-24T07:56:51.770004+0000","last_clean":"2023-11-24T07:56:51.770004+0000","last_became_active":"2023-11-24T07:56:49.998590+0000","last_became_peered":"2023-11-24T07:56:49.998590+0000","last_unstale":"2023-11-24T07:56:51.770004+0000","last_undegraded":"2023-11-24T07:56:51.770004+0000","last_fullsized":"2023-11-24T07:56:51.770004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273926+0000","last_change":"2023-11-24T07:56:49.000118+0000","last_active":"2023-11-24T07:56:51.273926+0000","last_peered":"2023-11-24T07:56:51.273926+0000","last_clean":"2023-11-24T07:56:51.273926+0000","last_became_active":"2023-11-24T07:56:48.999794+0000","last_became_peered":"2023-11-24T07:56:48.999794+0000","last_unstale":"2023-11-24T07:56:51.273926+0000","last_undegraded":"2023-11-24T07:56:51.273926+0000","last_fullsized":"2023-11-24T07:56:51.273926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986815+0000","last_change":"2023-11-24T07:56:49.989959+0000","last_active":"2023-11-24T07:56:50.986815+0000","last_peered":"2023-11-24T07:56:50.986815+0000","last_clean":"2023-11-24T07:56:50.986815+0000","last_became_active":"2023-11-24T07:56:49.989687+0000","last_became_peered":"2023-11-24T07:56:49.989687+0000","last_unstale":"2023-11-24T07:56:50.986815+0000","last_undegraded":"2023-11-24T07:56:50.986815+0000","last_fullsized":"2023-11-24T07:56:50.986815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262043+0000","last_change":"2023-11-24T07:56:48.988881+0000","last_active":"2023-11-24T07:56:51.262043+0000","last_peered":"2023-11-24T07:56:51.262043+0000","last_clean":"2023-11-24T07:56:51.262043+0000","last_became_active":"2023-11-24T07:56:48.988590+0000","last_became_peered":"2023-11-24T07:56:48.988590+0000","last_unstale":"2023-11-24T07:56:51.262043+0000","last_undegraded":"2023-11-24T07:56:51.262043+0000","last_fullsized":"2023-11-24T07:56:51.262043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987903+0000","last_change":"2023-11-24T07:56:49.985992+0000","last_active":"2023-11-24T07:56:50.987903+0000","last_peered":"2023-11-24T07:56:50.987903+0000","last_clean":"2023-11-24T07:56:50.987903+0000","last_became_active":"2023-11-24T07:56:49.985719+0000","last_became_peered":"2023-11-24T07:56:49.985719+0000","last_unstale":"2023-11-24T07:56:50.987903+0000","last_undegraded":"2023-11-24T07:56:50.987903+0000","last_fullsized":"2023-11-24T07:56:50.987903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.272371+0000","last_change":"2023-11-24T07:56:48.986496+0000","last_active":"2023-11-24T07:56:51.272371+0000","last_peered":"2023-11-24T07:56:51.272371+0000","last_clean":"2023-11-24T07:56:51.272371+0000","last_became_active":"2023-11-24T07:56:48.986172+0000","last_became_peered":"2023-11-24T07:56:48.986172+0000","last_unstale":"2023-11-24T07:56:51.272371+0000","last_undegraded":"2023-11-24T07:56:51.272371+0000","last_fullsized":"2023-11-24T07:56:51.272371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769754+0000","last_change":"2023-11-24T07:56:49.979739+0000","last_active":"2023-11-24T07:56:51.769754+0000","last_peered":"2023-11-24T07:56:51.769754+0000","last_clean":"2023-11-24T07:56:51.769754+0000","last_became_active":"2023-11-24T07:56:49.979473+0000","last_became_peered":"2023-11-24T07:56:49.979473+0000","last_unstale":"2023-11-24T07:56:51.769754+0000","last_undegraded":"2023-11-24T07:56:51.769754+0000","last_fullsized":"2023-11-24T07:56:51.769754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:05.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268565+0000","last_change":"2023-11-24T07:56:48.989819+0000","last_active":"2023-11-24T07:56:51.268565+0000","last_peered":"2023-11-24T07:56:51.268565+0000","last_clean":"2023-11-24T07:56:51.268565+0000","last_became_active":"2023-11-24T07:56:48.989226+0000","last_became_peered":"2023-11-24T07:56:48.989226+0000","last_unstale":"2023-11-24T07:56:51.268565+0000","last_undegraded":"2023-11-24T07:56:51.268565+0000","last_fullsized":"2023-11-24T07:56:51.268565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:44.234559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987828+0000","last_change":"2023-11-24T07:56:49.990806+0000","last_active":"2023-11-24T07:56:50.987828+0000","last_peered":"2023-11-24T07:56:50.987828+0000","last_clean":"2023-11-24T07:56:50.987828+0000","last_became_active":"2023-11-24T07:56:49.990478+0000","last_became_peered":"2023-11-24T07:56:49.990478+0000","last_unstale":"2023-11-24T07:56:50.987828+0000","last_undegraded":"2023-11-24T07:56:50.987828+0000","last_fullsized":"2023-11-24T07:56:50.987828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.261967+0000","last_change":"2023-11-24T07:56:48.987232+0000","last_active":"2023-11-24T07:56:51.261967+0000","last_peered":"2023-11-24T07:56:51.261967+0000","last_clean":"2023-11-24T07:56:51.261967+0000","last_became_active":"2023-11-24T07:56:48.986874+0000","last_became_peered":"2023-11-24T07:56:48.986874+0000","last_unstale":"2023-11-24T07:56:51.261967+0000","last_undegraded":"2023-11-24T07:56:51.261967+0000","last_fullsized":"2023-11-24T07:56:51.261967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767117+0000","last_change":"2023-11-24T07:56:50.005621+0000","last_active":"2023-11-24T07:56:51.767117+0000","last_peered":"2023-11-24T07:56:51.767117+0000","last_clean":"2023-11-24T07:56:51.767117+0000","last_became_active":"2023-11-24T07:56:50.004796+0000","last_became_peered":"2023-11-24T07:56:50.004796+0000","last_unstale":"2023-11-24T07:56:51.767117+0000","last_undegraded":"2023-11-24T07:56:51.767117+0000","last_fullsized":"2023-11-24T07:56:51.767117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273588+0000","last_change":"2023-11-24T07:56:48.982818+0000","last_active":"2023-11-24T07:56:51.273588+0000","last_peered":"2023-11-24T07:56:51.273588+0000","last_clean":"2023-11-24T07:56:51.273588+0000","last_became_active":"2023-11-24T07:56:48.982473+0000","last_became_peered":"2023-11-24T07:56:48.982473+0000","last_unstale":"2023-11-24T07:56:51.273588+0000","last_undegraded":"2023-11-24T07:56:51.273588+0000","last_fullsized":"2023-11-24T07:56:51.273588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:40.373215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987624+0000","last_change":"2023-11-24T07:56:49.990672+0000","last_active":"2023-11-24T07:56:50.987624+0000","last_peered":"2023-11-24T07:56:50.987624+0000","last_clean":"2023-11-24T07:56:50.987624+0000","last_became_active":"2023-11-24T07:56:49.990376+0000","last_became_peered":"2023-11-24T07:56:49.990376+0000","last_unstale":"2023-11-24T07:56:50.987624+0000","last_undegraded":"2023-11-24T07:56:50.987624+0000","last_fullsized":"2023-11-24T07:56:50.987624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986880+0000","last_change":"2023-11-24T07:56:48.988508+0000","last_active":"2023-11-24T07:56:50.986880+0000","last_peered":"2023-11-24T07:56:50.986880+0000","last_clean":"2023-11-24T07:56:50.986880+0000","last_became_active":"2023-11-24T07:56:48.988087+0000","last_became_peered":"2023-11-24T07:56:48.988087+0000","last_unstale":"2023-11-24T07:56:50.986880+0000","last_undegraded":"2023-11-24T07:56:50.986880+0000","last_fullsized":"2023-11-24T07:56:50.986880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:06.606043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987995+0000","last_change":"2023-11-24T07:56:49.990816+0000","last_active":"2023-11-24T07:56:50.987995+0000","last_peered":"2023-11-24T07:56:50.987995+0000","last_clean":"2023-11-24T07:56:50.987995+0000","last_became_active":"2023-11-24T07:56:49.990509+0000","last_became_peered":"2023-11-24T07:56:49.990509+0000","last_unstale":"2023-11-24T07:56:50.987995+0000","last_undegraded":"2023-11-24T07:56:50.987995+0000","last_fullsized":"2023-11-24T07:56:50.987995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273661+0000","last_change":"2023-11-24T07:56:48.992645+0000","last_active":"2023-11-24T07:56:51.273661+0000","last_peered":"2023-11-24T07:56:51.273661+0000","last_clean":"2023-11-24T07:56:51.273661+0000","last_became_active":"2023-11-24T07:56:48.992283+0000","last_became_peered":"2023-11-24T07:56:48.992283+0000","last_unstale":"2023-11-24T07:56:51.273661+0000","last_undegraded":"2023-11-24T07:56:51.273661+0000","last_fullsized":"2023-11-24T07:56:51.273661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:53.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988381+0000","last_change":"2023-11-24T07:56:49.993271+0000","last_active":"2023-11-24T07:56:50.988381+0000","last_peered":"2023-11-24T07:56:50.988381+0000","last_clean":"2023-11-24T07:56:50.988381+0000","last_became_active":"2023-11-24T07:56:49.992353+0000","last_became_peered":"2023-11-24T07:56:49.992353+0000","last_unstale":"2023-11-24T07:56:50.988381+0000","last_undegraded":"2023-11-24T07:56:50.988381+0000","last_fullsized":"2023-11-24T07:56:50.988381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:59.074191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273981+0000","last_change":"2023-11-24T07:56:48.984821+0000","last_active":"2023-11-24T07:56:51.273981+0000","last_peered":"2023-11-24T07:56:51.273981+0000","last_clean":"2023-11-24T07:56:51.273981+0000","last_became_active":"2023-11-24T07:56:48.984545+0000","last_became_peered":"2023-11-24T07:56:48.984545+0000","last_unstale":"2023-11-24T07:56:51.273981+0000","last_undegraded":"2023-11-24T07:56:51.273981+0000","last_fullsized":"2023-11-24T07:56:51.273981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466212+0000","last_change":"2023-11-24T07:56:49.994668+0000","last_active":"2023-11-24T07:56:51.466212+0000","last_peered":"2023-11-24T07:56:51.466212+0000","last_clean":"2023-11-24T07:56:51.466212+0000","last_became_active":"2023-11-24T07:56:49.993993+0000","last_became_peered":"2023-11-24T07:56:49.993993+0000","last_unstale":"2023-11-24T07:56:51.466212+0000","last_undegraded":"2023-11-24T07:56:51.466212+0000","last_fullsized":"2023-11-24T07:56:51.466212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273642+0000","last_change":"2023-11-24T07:56:48.997388+0000","last_active":"2023-11-24T07:56:51.273642+0000","last_peered":"2023-11-24T07:56:51.273642+0000","last_clean":"2023-11-24T07:56:51.273642+0000","last_became_active":"2023-11-24T07:56:48.997143+0000","last_became_peered":"2023-11-24T07:56:48.997143+0000","last_unstale":"2023-11-24T07:56:51.273642+0000","last_undegraded":"2023-11-24T07:56:51.273642+0000","last_fullsized":"2023-11-24T07:56:51.273642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988126+0000","last_change":"2023-11-24T07:56:50.017444+0000","last_active":"2023-11-24T07:56:50.988126+0000","last_peered":"2023-11-24T07:56:50.988126+0000","last_clean":"2023-11-24T07:56:50.988126+0000","last_became_active":"2023-11-24T07:56:50.017218+0000","last_became_peered":"2023-11-24T07:56:50.017218+0000","last_unstale":"2023-11-24T07:56:50.988126+0000","last_undegraded":"2023-11-24T07:56:50.988126+0000","last_fullsized":"2023-11-24T07:56:50.988126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.973044+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:56:49.973044+0000","last_peered":"2023-11-24T07:56:49.973044+0000","last_clean":"2023-11-24T07:56:49.973044+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:56:49.973044+0000","last_undegraded":"2023-11-24T07:56:49.973044+0000","last_fullsized":"2023-11-24T07:56:49.973044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268608+0000","last_change":"2023-11-24T07:56:48.992283+0000","last_active":"2023-11-24T07:56:51.268608+0000","last_peered":"2023-11-24T07:56:51.268608+0000","last_clean":"2023-11-24T07:56:51.268608+0000","last_became_active":"2023-11-24T07:56:48.991808+0000","last_became_peered":"2023-11-24T07:56:48.991808+0000","last_unstale":"2023-11-24T07:56:51.268608+0000","last_undegraded":"2023-11-24T07:56:51.268608+0000","last_fullsized":"2023-11-24T07:56:51.268608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:24.480996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988271+0000","last_change":"2023-11-24T07:56:50.020101+0000","last_active":"2023-11-24T07:56:50.988271+0000","last_peered":"2023-11-24T07:56:50.988271+0000","last_clean":"2023-11-24T07:56:50.988271+0000","last_became_active":"2023-11-24T07:56:50.019553+0000","last_became_peered":"2023-11-24T07:56:50.019553+0000","last_unstale":"2023-11-24T07:56:50.988271+0000","last_undegraded":"2023-11-24T07:56:50.988271+0000","last_fullsized":"2023-11-24T07:56:50.988271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987627+0000","last_change":"2023-11-24T07:56:48.982233+0000","last_active":"2023-11-24T07:56:50.987627+0000","last_peered":"2023-11-24T07:56:50.987627+0000","last_clean":"2023-11-24T07:56:50.987627+0000","last_became_active":"2023-11-24T07:56:48.981854+0000","last_became_peered":"2023-11-24T07:56:48.981854+0000","last_unstale":"2023-11-24T07:56:50.987627+0000","last_undegraded":"2023-11-24T07:56:50.987627+0000","last_fullsized":"2023-11-24T07:56:50.987627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769576+0000","last_change":"2023-11-24T07:56:49.983532+0000","last_active":"2023-11-24T07:56:51.769576+0000","last_peered":"2023-11-24T07:56:51.769576+0000","last_clean":"2023-11-24T07:56:51.769576+0000","last_became_active":"2023-11-24T07:56:49.983242+0000","last_became_peered":"2023-11-24T07:56:49.983242+0000","last_unstale":"2023-11-24T07:56:51.769576+0000","last_undegraded":"2023-11-24T07:56:51.769576+0000","last_fullsized":"2023-11-24T07:56:51.769576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:48.183813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273612+0000","last_change":"2023-11-24T07:56:48.992743+0000","last_active":"2023-11-24T07:56:51.273612+0000","last_peered":"2023-11-24T07:56:51.273612+0000","last_clean":"2023-11-24T07:56:51.273612+0000","last_became_active":"2023-11-24T07:56:48.992300+0000","last_became_peered":"2023-11-24T07:56:48.992300+0000","last_unstale":"2023-11-24T07:56:51.273612+0000","last_undegraded":"2023-11-24T07:56:51.273612+0000","last_fullsized":"2023-11-24T07:56:51.273612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452592+0000","last_change":"2023-11-24T07:56:49.981866+0000","last_active":"2023-11-24T07:56:51.452592+0000","last_peered":"2023-11-24T07:56:51.452592+0000","last_clean":"2023-11-24T07:56:51.452592+0000","last_became_active":"2023-11-24T07:56:49.981342+0000","last_became_peered":"2023-11-24T07:56:49.981342+0000","last_unstale":"2023-11-24T07:56:51.452592+0000","last_undegraded":"2023-11-24T07:56:51.452592+0000","last_fullsized":"2023-11-24T07:56:51.452592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268592+0000","last_change":"2023-11-24T07:56:48.993830+0000","last_active":"2023-11-24T07:56:51.268592+0000","last_peered":"2023-11-24T07:56:51.268592+0000","last_clean":"2023-11-24T07:56:51.268592+0000","last_became_active":"2023-11-24T07:56:48.991880+0000","last_became_peered":"2023-11-24T07:56:48.991880+0000","last_unstale":"2023-11-24T07:56:51.268592+0000","last_undegraded":"2023-11-24T07:56:51.268592+0000","last_fullsized":"2023-11-24T07:56:51.268592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986711+0000","last_change":"2023-11-24T07:56:50.002741+0000","last_active":"2023-11-24T07:56:50.986711+0000","last_peered":"2023-11-24T07:56:50.986711+0000","last_clean":"2023-11-24T07:56:50.986711+0000","last_became_active":"2023-11-24T07:56:49.994282+0000","last_became_peered":"2023-11-24T07:56:49.994282+0000","last_unstale":"2023-11-24T07:56:50.986711+0000","last_undegraded":"2023-11-24T07:56:50.986711+0000","last_fullsized":"2023-11-24T07:56:50.986711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273906+0000","last_change":"2023-11-24T07:56:48.988654+0000","last_active":"2023-11-24T07:56:51.273906+0000","last_peered":"2023-11-24T07:56:51.273906+0000","last_clean":"2023-11-24T07:56:51.273906+0000","last_became_active":"2023-11-24T07:56:48.988250+0000","last_became_peered":"2023-11-24T07:56:48.988250+0000","last_unstale":"2023-11-24T07:56:51.273906+0000","last_undegraded":"2023-11-24T07:56:51.273906+0000","last_fullsized":"2023-11-24T07:56:51.273906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466296+0000","last_change":"2023-11-24T07:56:50.001254+0000","last_active":"2023-11-24T07:56:51.466296+0000","last_peered":"2023-11-24T07:56:51.466296+0000","last_clean":"2023-11-24T07:56:51.466296+0000","last_became_active":"2023-11-24T07:56:49.996268+0000","last_became_peered":"2023-11-24T07:56:49.996268+0000","last_unstale":"2023-11-24T07:56:51.466296+0000","last_undegraded":"2023-11-24T07:56:51.466296+0000","last_fullsized":"2023-11-24T07:56:51.466296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988286+0000","last_change":"2023-11-24T07:56:48.991678+0000","last_active":"2023-11-24T07:56:50.988286+0000","last_peered":"2023-11-24T07:56:50.988286+0000","last_clean":"2023-11-24T07:56:50.988286+0000","last_became_active":"2023-11-24T07:56:48.991306+0000","last_became_peered":"2023-11-24T07:56:48.991306+0000","last_unstale":"2023-11-24T07:56:50.988286+0000","last_undegraded":"2023-11-24T07:56:50.988286+0000","last_fullsized":"2023-11-24T07:56:50.988286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452686+0000","last_change":"2023-11-24T07:56:49.983208+0000","last_active":"2023-11-24T07:56:51.452686+0000","last_peered":"2023-11-24T07:56:51.452686+0000","last_clean":"2023-11-24T07:56:51.452686+0000","last_became_active":"2023-11-24T07:56:49.982720+0000","last_became_peered":"2023-11-24T07:56:49.982720+0000","last_unstale":"2023-11-24T07:56:51.452686+0000","last_undegraded":"2023-11-24T07:56:51.452686+0000","last_fullsized":"2023-11-24T07:56:51.452686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452823+0000","last_change":"2023-11-24T07:56:48.993105+0000","last_active":"2023-11-24T07:56:51.452823+0000","last_peered":"2023-11-24T07:56:51.452823+0000","last_clean":"2023-11-24T07:56:51.452823+0000","last_became_active":"2023-11-24T07:56:48.991445+0000","last_became_peered":"2023-11-24T07:56:48.991445+0000","last_unstale":"2023-11-24T07:56:51.452823+0000","last_undegraded":"2023-11-24T07:56:51.452823+0000","last_fullsized":"2023-11-24T07:56:51.452823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989165+0000","last_change":"2023-11-24T07:56:49.986008+0000","last_active":"2023-11-24T07:56:50.989165+0000","last_peered":"2023-11-24T07:56:50.989165+0000","last_clean":"2023-11-24T07:56:50.989165+0000","last_became_active":"2023-11-24T07:56:49.985648+0000","last_became_peered":"2023-11-24T07:56:49.985648+0000","last_unstale":"2023-11-24T07:56:50.989165+0000","last_undegraded":"2023-11-24T07:56:50.989165+0000","last_fullsized":"2023-11-24T07:56:50.989165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262140+0000","last_change":"2023-11-24T07:56:48.995945+0000","last_active":"2023-11-24T07:56:51.262140+0000","last_peered":"2023-11-24T07:56:51.262140+0000","last_clean":"2023-11-24T07:56:51.262140+0000","last_became_active":"2023-11-24T07:56:48.995477+0000","last_became_peered":"2023-11-24T07:56:48.995477+0000","last_unstale":"2023-11-24T07:56:51.262140+0000","last_undegraded":"2023-11-24T07:56:51.262140+0000","last_fullsized":"2023-11-24T07:56:51.262140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769818+0000","last_change":"2023-11-24T07:56:49.995099+0000","last_active":"2023-11-24T07:56:51.769818+0000","last_peered":"2023-11-24T07:56:51.769818+0000","last_clean":"2023-11-24T07:56:51.769818+0000","last_became_active":"2023-11-24T07:56:49.994601+0000","last_became_peered":"2023-11-24T07:56:49.994601+0000","last_unstale":"2023-11-24T07:56:51.769818+0000","last_undegraded":"2023-11-24T07:56:51.769818+0000","last_fullsized":"2023-11-24T07:56:51.769818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987462+0000","last_change":"2023-11-24T07:56:48.988789+0000","last_active":"2023-11-24T07:56:50.987462+0000","last_peered":"2023-11-24T07:56:50.987462+0000","last_clean":"2023-11-24T07:56:50.987462+0000","last_became_active":"2023-11-24T07:56:48.988504+0000","last_became_peered":"2023-11-24T07:56:48.988504+0000","last_unstale":"2023-11-24T07:56:50.987462+0000","last_undegraded":"2023-11-24T07:56:50.987462+0000","last_fullsized":"2023-11-24T07:56:50.987462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986477+0000","last_change":"2023-11-24T07:56:49.988759+0000","last_active":"2023-11-24T07:56:50.986477+0000","last_peered":"2023-11-24T07:56:50.986477+0000","last_clean":"2023-11-24T07:56:50.986477+0000","last_became_active":"2023-11-24T07:56:49.984052+0000","last_became_peered":"2023-11-24T07:56:49.984052+0000","last_unstale":"2023-11-24T07:56:50.986477+0000","last_undegraded":"2023-11-24T07:56:50.986477+0000","last_fullsized":"2023-11-24T07:56:50.986477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273880+0000","last_change":"2023-11-24T07:56:48.985064+0000","last_active":"2023-11-24T07:56:51.273880+0000","last_peered":"2023-11-24T07:56:51.273880+0000","last_clean":"2023-11-24T07:56:51.273880+0000","last_became_active":"2023-11-24T07:56:48.984182+0000","last_became_peered":"2023-11-24T07:56:48.984182+0000","last_unstale":"2023-11-24T07:56:51.273880+0000","last_undegraded":"2023-11-24T07:56:51.273880+0000","last_fullsized":"2023-11-24T07:56:51.273880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:08.996477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988201+0000","last_change":"2023-11-24T07:56:49.993700+0000","last_active":"2023-11-24T07:56:50.988201+0000","last_peered":"2023-11-24T07:56:50.988201+0000","last_clean":"2023-11-24T07:56:50.988201+0000","last_became_active":"2023-11-24T07:56:49.993441+0000","last_became_peered":"2023-11-24T07:56:49.993441+0000","last_unstale":"2023-11-24T07:56:50.988201+0000","last_undegraded":"2023-11-24T07:56:50.988201+0000","last_fullsized":"2023-11-24T07:56:50.988201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273889+0000","last_change":"2023-11-24T07:56:48.990448+0000","last_active":"2023-11-24T07:56:51.273889+0000","last_peered":"2023-11-24T07:56:51.273889+0000","last_clean":"2023-11-24T07:56:51.273889+0000","last_became_active":"2023-11-24T07:56:48.990125+0000","last_became_peered":"2023-11-24T07:56:48.990125+0000","last_unstale":"2023-11-24T07:56:51.273889+0000","last_undegraded":"2023-11-24T07:56:51.273889+0000","last_fullsized":"2023-11-24T07:56:51.273889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988606+0000","last_change":"2023-11-24T07:56:49.996725+0000","last_active":"2023-11-24T07:56:50.988606+0000","last_peered":"2023-11-24T07:56:50.988606+0000","last_clean":"2023-11-24T07:56:50.988606+0000","last_became_active":"2023-11-24T07:56:49.996362+0000","last_became_peered":"2023-11-24T07:56:49.996362+0000","last_unstale":"2023-11-24T07:56:50.988606+0000","last_undegraded":"2023-11-24T07:56:50.988606+0000","last_fullsized":"2023-11-24T07:56:50.988606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987884+0000","last_change":"2023-11-24T07:56:48.991238+0000","last_active":"2023-11-24T07:56:50.987884+0000","last_peered":"2023-11-24T07:56:50.987884+0000","last_clean":"2023-11-24T07:56:50.987884+0000","last_became_active":"2023-11-24T07:56:48.990808+0000","last_became_peered":"2023-11-24T07:56:48.990808+0000","last_unstale":"2023-11-24T07:56:50.987884+0000","last_undegraded":"2023-11-24T07:56:50.987884+0000","last_fullsized":"2023-11-24T07:56:50.987884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:47.459786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767034+0000","last_change":"2023-11-24T07:56:49.992018+0000","last_active":"2023-11-24T07:56:51.767034+0000","last_peered":"2023-11-24T07:56:51.767034+0000","last_clean":"2023-11-24T07:56:51.767034+0000","last_became_active":"2023-11-24T07:56:49.990675+0000","last_became_peered":"2023-11-24T07:56:49.990675+0000","last_unstale":"2023-11-24T07:56:51.767034+0000","last_undegraded":"2023-11-24T07:56:51.767034+0000","last_fullsized":"2023-11-24T07:56:51.767034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466285+0000","last_change":"2023-11-24T07:56:50.009926+0000","last_active":"2023-11-24T07:56:51.466285+0000","last_peered":"2023-11-24T07:56:51.466285+0000","last_clean":"2023-11-24T07:56:51.466285+0000","last_became_active":"2023-11-24T07:56:50.009644+0000","last_became_peered":"2023-11-24T07:56:50.009644+0000","last_unstale":"2023-11-24T07:56:51.466285+0000","last_undegraded":"2023-11-24T07:56:51.466285+0000","last_fullsized":"2023-11-24T07:56:51.466285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987753+0000","last_change":"2023-11-24T07:56:48.995707+0000","last_active":"2023-11-24T07:56:50.987753+0000","last_peered":"2023-11-24T07:56:50.987753+0000","last_clean":"2023-11-24T07:56:50.987753+0000","last_became_active":"2023-11-24T07:56:48.994686+0000","last_became_peered":"2023-11-24T07:56:48.994686+0000","last_unstale":"2023-11-24T07:56:50.987753+0000","last_undegraded":"2023-11-24T07:56:50.987753+0000","last_fullsized":"2023-11-24T07:56:50.987753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466129+0000","last_change":"2023-11-24T07:56:49.999352+0000","last_active":"2023-11-24T07:56:51.466129+0000","last_peered":"2023-11-24T07:56:51.466129+0000","last_clean":"2023-11-24T07:56:51.466129+0000","last_became_active":"2023-11-24T07:56:49.998790+0000","last_became_peered":"2023-11-24T07:56:49.998790+0000","last_unstale":"2023-11-24T07:56:51.466129+0000","last_undegraded":"2023-11-24T07:56:51.466129+0000","last_fullsized":"2023-11-24T07:56:51.466129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988009+0000","last_change":"2023-11-24T07:56:48.994077+0000","last_active":"2023-11-24T07:56:50.988009+0000","last_peered":"2023-11-24T07:56:50.988009+0000","last_clean":"2023-11-24T07:56:50.988009+0000","last_became_active":"2023-11-24T07:56:48.993737+0000","last_became_peered":"2023-11-24T07:56:48.993737+0000","last_unstale":"2023-11-24T07:56:50.988009+0000","last_undegraded":"2023-11-24T07:56:50.988009+0000","last_fullsized":"2023-11-24T07:56:50.988009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769964+0000","last_change":"2023-11-24T07:56:50.020056+0000","last_active":"2023-11-24T07:56:51.769964+0000","last_peered":"2023-11-24T07:56:51.769964+0000","last_clean":"2023-11-24T07:56:51.769964+0000","last_became_active":"2023-11-24T07:56:50.019400+0000","last_became_peered":"2023-11-24T07:56:50.019400+0000","last_unstale":"2023-11-24T07:56:51.769964+0000","last_undegraded":"2023-11-24T07:56:51.769964+0000","last_fullsized":"2023-11-24T07:56:51.769964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988991+0000","last_change":"2023-11-24T07:56:48.995621+0000","last_active":"2023-11-24T07:56:50.988991+0000","last_peered":"2023-11-24T07:56:50.988991+0000","last_clean":"2023-11-24T07:56:50.988991+0000","last_became_active":"2023-11-24T07:56:48.995263+0000","last_became_peered":"2023-11-24T07:56:48.995263+0000","last_unstale":"2023-11-24T07:56:50.988991+0000","last_undegraded":"2023-11-24T07:56:50.988991+0000","last_fullsized":"2023-11-24T07:56:50.988991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988856+0000","last_change":"2023-11-24T07:56:49.997265+0000","last_active":"2023-11-24T07:56:50.988856+0000","last_peered":"2023-11-24T07:56:50.988856+0000","last_clean":"2023-11-24T07:56:50.988856+0000","last_became_active":"2023-11-24T07:56:49.996951+0000","last_became_peered":"2023-11-24T07:56:49.996951+0000","last_unstale":"2023-11-24T07:56:50.988856+0000","last_undegraded":"2023-11-24T07:56:50.988856+0000","last_fullsized":"2023-11-24T07:56:50.988856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.272488+0000","last_change":"2023-11-24T07:56:48.997262+0000","last_active":"2023-11-24T07:56:51.272488+0000","last_peered":"2023-11-24T07:56:51.272488+0000","last_clean":"2023-11-24T07:56:51.272488+0000","last_became_active":"2023-11-24T07:56:48.996927+0000","last_became_peered":"2023-11-24T07:56:48.996927+0000","last_unstale":"2023-11-24T07:56:51.272488+0000","last_undegraded":"2023-11-24T07:56:51.272488+0000","last_fullsized":"2023-11-24T07:56:51.272488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":69981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":69891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7810000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6660000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1420000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":70051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:56:58.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:56:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 Processor -- start 2023-11-24T07:56:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 -- start start 2023-11-24T07:56:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f395406d920 0x7f3954070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3954145060 con 0x7f3954144c80 2023-11-24T07:56:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3954071fd0 con 0x7f39540ac630 2023-11-24T07:56:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.951+0000 7f395b806640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3954071450 con 0x7f395406d920 2023-11-24T07:56:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f39595a2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3954144c80 0x7f39540abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46028/0 (socket says 172.21.15.5:46028) 2023-11-24T07:56:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f39595a2640 1 -- 172.21.15.5:0/3233515123 learned_addr learned my addr 172.21.15.5:0/3233515123 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:56:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f3959da3640 1 --2- 172.21.15.5:0/3233515123 >> v2:172.21.15.5:3300/0 conn(0x7f395406d920 0x7f3954070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686339420 0 0) 0x7f3954145060 con 0x7f3954144c80 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3940003530 con 0x7f3954144c80 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780999843 0 0) 0x7f3954071fd0 con 0x7f39540ac630 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f3959da3640 1 -- 172.21.15.5:0/3233515123 >> v1:172.21.15.102:6789/0 conn(0x7f39540ac630 legacy=0x7f39540706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f3959da3640 1 -- 172.21.15.5:0/3233515123 >> v1:172.21.15.5:6789/0 conn(0x7f3954144c80 legacy=0x7f39540abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f3959da3640 1 -- 172.21.15.5:0/3233515123 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954071730 con 0x7f395406d920 2023-11-24T07:56:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f3959da3640 1 --2- 172.21.15.5:0/3233515123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f395406d920 0x7f3954070df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f394c009d90 tx=0x7f394c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a44237635de472 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0a59e0 con 0x7f395406d920 2023-11-24T07:56:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c0a5b40 con 0x7f395406d920 2023-11-24T07:56:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.955+0000 7f394bfff640 1 -- 172.21.15.5:0/3233515123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0ad440 con 0x7f395406d920 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- 172.21.15.5:0/3233515123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f395406d920 msgr2=0x7f3954070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 --2- 172.21.15.5:0/3233515123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f395406d920 0x7f3954070df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f394c009d90 tx=0x7f394c01c920 comp rx=0 tx=0).stop 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- 172.21.15.5:0/3233515123 shutdown_connections 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 --2- 172.21.15.5:0/3233515123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f395406d920 0x7f3954070df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- 172.21.15.5:0/3233515123 >> 172.21.15.5:0/3233515123 conn(0x7f39540b0c40 msgr2=0x7f39540b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- 172.21.15.5:0/3233515123 shutdown_connections 2023-11-24T07:56:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- 172.21.15.5:0/3233515123 wait complete. 2023-11-24T07:56:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 Processor -- start 2023-11-24T07:56:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- start start 2023-11-24T07:56:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395406d920 0x7f395409c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f39540ac630 0x7f395415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395415d0a0 con 0x7f3954144c80 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395415d380 con 0x7f395406d920 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f395b806640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395415d660 con 0x7f39540ac630 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f3959da3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f3959da3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57460/0 (socket says 172.21.15.5:57460) 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f3959da3640 1 -- 172.21.15.5:0/102414020 learned_addr learned my addr 172.21.15.5:0/102414020 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f39595a2640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395406d920 0x7f395409c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.959+0000 7f3958da1640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f39540ac630 0x7f395415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 -- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f39540ac630 msgr2=0x7f395415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f39540ac630 0x7f395415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 -- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395406d920 msgr2=0x7f395409c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395406d920 0x7f395409c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 -- 172.21.15.5:0/102414020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009a70 con 0x7f3954144c80 2023-11-24T07:56:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3959da3640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f394c0b0040 tx=0x7f394c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0add30 con 0x7f3954144c80 2023-11-24T07:56:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c0ade90 con 0x7f3954144c80 2023-11-24T07:56:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395415d940 con 0x7f3954144c80 2023-11-24T07:56:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c003be0 con 0x7f3954144c80 2023-11-24T07:56:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395415e680 con 0x7f3954144c80 2023-11-24T07:56:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540b1ba0 con 0x7f3954144c80 2023-11-24T07:56:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f394c0c4450 con 0x7f3954144c80 2023-11-24T07:56:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 0x7f3938068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f394c11eb30 con 0x7f3954144c80 2023-11-24T07:56:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.963+0000 7f39595a2640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 0x7f3938068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.967+0000 7f39595a2640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 0x7f3938068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3950007fd0 tx=0x7f3950009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:58.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:58.967+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f394c0ebe80 con 0x7f3954144c80 2023-11-24T07:56:59.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.127+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f395415d4f0 con 0x7f39380664a0 2023-11-24T07:56:59.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f3949ffb640 1 -- 172.21.15.5:0/102414020 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264627 (secure 0 0 0) 0x7f395415d4f0 con 0x7f39380664a0 2023-11-24T07:56:59.139 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:56:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 msgr2=0x7f3938068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 0x7f3938068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3950007fd0 tx=0x7f3950009040 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 msgr2=0x7f395415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f394c0b0040 tx=0x7f394c0196c0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 shutdown_connections 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f39380664a0 0x7f3938068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3954144c80 0x7f395415c870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f39540ac630 0x7f395415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 --2- 172.21.15.5:0/102414020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395406d920 0x7f395409c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 >> 172.21.15.5:0/102414020 conn(0x7f39540b0c40 msgr2=0x7f39540add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 shutdown_connections 2023-11-24T07:56:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.135+0000 7f395b806640 1 -- 172.21.15.5:0/102414020 wait complete. 2023-11-24T07:56:59.159 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T07:56:57.237365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235644,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739076,"statfs":{"total":773094113280,"available":772852813824,"internally_reserved":0,"allocated":2875392,"data_stored":1748760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988313+0000","last_change":"2023-11-24T07:56:50.004858+0000","last_active":"2023-11-24T07:56:50.988313+0000","last_peered":"2023-11-24T07:56:50.988313+0000","last_clean":"2023-11-24T07:56:50.988313+0000","last_became_active":"2023-11-24T07:56:49.993400+0000","last_became_peered":"2023-11-24T07:56:49.993400+0000","last_unstale":"2023-11-24T07:56:50.988313+0000","last_undegraded":"2023-11-24T07:56:50.988313+0000","last_fullsized":"2023-11-24T07:56:50.988313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:57.211418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452806+0000","last_change":"2023-11-24T07:56:49.991230+0000","last_active":"2023-11-24T07:56:51.452806+0000","last_peered":"2023-11-24T07:56:51.452806+0000","last_clean":"2023-11-24T07:56:51.452806+0000","last_became_active":"2023-11-24T07:56:49.990940+0000","last_became_peered":"2023-11-24T07:56:49.990940+0000","last_unstale":"2023-11-24T07:56:51.452806+0000","last_undegraded":"2023-11-24T07:56:51.452806+0000","last_fullsized":"2023-11-24T07:56:51.452806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769873+0000","last_change":"2023-11-24T07:56:49.989286+0000","last_active":"2023-11-24T07:56:51.769873+0000","last_peered":"2023-11-24T07:56:51.769873+0000","last_clean":"2023-11-24T07:56:51.769873+0000","last_became_active":"2023-11-24T07:56:49.988948+0000","last_became_peered":"2023-11-24T07:56:49.988948+0000","last_unstale":"2023-11-24T07:56:51.769873+0000","last_undegraded":"2023-11-24T07:56:51.769873+0000","last_fullsized":"2023-11-24T07:56:51.769873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466062+0000","last_change":"2023-11-24T07:56:49.994907+0000","last_active":"2023-11-24T07:56:51.466062+0000","last_peered":"2023-11-24T07:56:51.466062+0000","last_clean":"2023-11-24T07:56:51.466062+0000","last_became_active":"2023-11-24T07:56:49.994332+0000","last_became_peered":"2023-11-24T07:56:49.994332+0000","last_unstale":"2023-11-24T07:56:51.466062+0000","last_undegraded":"2023-11-24T07:56:51.466062+0000","last_fullsized":"2023-11-24T07:56:51.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987792+0000","last_change":"2023-11-24T07:56:49.998831+0000","last_active":"2023-11-24T07:56:50.987792+0000","last_peered":"2023-11-24T07:56:50.987792+0000","last_clean":"2023-11-24T07:56:50.987792+0000","last_became_active":"2023-11-24T07:56:49.991235+0000","last_became_peered":"2023-11-24T07:56:49.991235+0000","last_unstale":"2023-11-24T07:56:50.987792+0000","last_undegraded":"2023-11-24T07:56:50.987792+0000","last_fullsized":"2023-11-24T07:56:50.987792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465842+0000","last_change":"2023-11-24T07:56:50.008660+0000","last_active":"2023-11-24T07:56:51.465842+0000","last_peered":"2023-11-24T07:56:51.465842+0000","last_clean":"2023-11-24T07:56:51.465842+0000","last_became_active":"2023-11-24T07:56:50.008297+0000","last_became_peered":"2023-11-24T07:56:50.008297+0000","last_unstale":"2023-11-24T07:56:51.465842+0000","last_undegraded":"2023-11-24T07:56:51.465842+0000","last_fullsized":"2023-11-24T07:56:51.465842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987569+0000","last_change":"2023-11-24T07:56:49.999624+0000","last_active":"2023-11-24T07:56:50.987569+0000","last_peered":"2023-11-24T07:56:50.987569+0000","last_clean":"2023-11-24T07:56:50.987569+0000","last_became_active":"2023-11-24T07:56:49.999370+0000","last_became_peered":"2023-11-24T07:56:49.999370+0000","last_unstale":"2023-11-24T07:56:50.987569+0000","last_undegraded":"2023-11-24T07:56:50.987569+0000","last_fullsized":"2023-11-24T07:56:50.987569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988066+0000","last_change":"2023-11-24T07:56:49.999092+0000","last_active":"2023-11-24T07:56:50.988066+0000","last_peered":"2023-11-24T07:56:50.988066+0000","last_clean":"2023-11-24T07:56:50.988066+0000","last_became_active":"2023-11-24T07:56:49.998578+0000","last_became_peered":"2023-11-24T07:56:49.998578+0000","last_unstale":"2023-11-24T07:56:50.988066+0000","last_undegraded":"2023-11-24T07:56:50.988066+0000","last_fullsized":"2023-11-24T07:56:50.988066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988332+0000","last_change":"2023-11-24T07:56:50.016980+0000","last_active":"2023-11-24T07:56:50.988332+0000","last_peered":"2023-11-24T07:56:50.988332+0000","last_clean":"2023-11-24T07:56:50.988332+0000","last_became_active":"2023-11-24T07:56:50.016704+0000","last_became_peered":"2023-11-24T07:56:50.016704+0000","last_unstale":"2023-11-24T07:56:50.988332+0000","last_undegraded":"2023-11-24T07:56:50.988332+0000","last_fullsized":"2023-11-24T07:56:50.988332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:13.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767300+0000","last_change":"2023-11-24T07:56:50.010849+0000","last_active":"2023-11-24T07:56:51.767300+0000","last_peered":"2023-11-24T07:56:51.767300+0000","last_clean":"2023-11-24T07:56:51.767300+0000","last_became_active":"2023-11-24T07:56:50.010479+0000","last_became_peered":"2023-11-24T07:56:50.010479+0000","last_unstale":"2023-11-24T07:56:51.767300+0000","last_undegraded":"2023-11-24T07:56:51.767300+0000","last_fullsized":"2023-11-24T07:56:51.767300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767408+0000","last_change":"2023-11-24T07:56:50.016938+0000","last_active":"2023-11-24T07:56:51.767408+0000","last_peered":"2023-11-24T07:56:51.767408+0000","last_clean":"2023-11-24T07:56:51.767408+0000","last_became_active":"2023-11-24T07:56:50.016537+0000","last_became_peered":"2023-11-24T07:56:50.016537+0000","last_unstale":"2023-11-24T07:56:51.767408+0000","last_undegraded":"2023-11-24T07:56:51.767408+0000","last_fullsized":"2023-11-24T07:56:51.767408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986876+0000","last_change":"2023-11-24T07:56:49.989957+0000","last_active":"2023-11-24T07:56:50.986876+0000","last_peered":"2023-11-24T07:56:50.986876+0000","last_clean":"2023-11-24T07:56:50.986876+0000","last_became_active":"2023-11-24T07:56:49.989604+0000","last_became_peered":"2023-11-24T07:56:49.989604+0000","last_unstale":"2023-11-24T07:56:50.986876+0000","last_undegraded":"2023-11-24T07:56:50.986876+0000","last_fullsized":"2023-11-24T07:56:50.986876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:45.779925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988569+0000","last_change":"2023-11-24T07:56:49.988221+0000","last_active":"2023-11-24T07:56:50.988569+0000","last_peered":"2023-11-24T07:56:50.988569+0000","last_clean":"2023-11-24T07:56:50.988569+0000","last_became_active":"2023-11-24T07:56:49.987909+0000","last_became_peered":"2023-11-24T07:56:49.987909+0000","last_unstale":"2023-11-24T07:56:50.988569+0000","last_undegraded":"2023-11-24T07:56:50.988569+0000","last_fullsized":"2023-11-24T07:56:50.988569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769607+0000","last_change":"2023-11-24T07:56:49.987632+0000","last_active":"2023-11-24T07:56:51.769607+0000","last_peered":"2023-11-24T07:56:51.769607+0000","last_clean":"2023-11-24T07:56:51.769607+0000","last_became_active":"2023-11-24T07:56:49.983904+0000","last_became_peered":"2023-11-24T07:56:49.983904+0000","last_unstale":"2023-11-24T07:56:51.769607+0000","last_undegraded":"2023-11-24T07:56:51.769607+0000","last_fullsized":"2023-11-24T07:56:51.769607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:10.002687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452591+0000","last_change":"2023-11-24T07:56:49.993099+0000","last_active":"2023-11-24T07:56:51.452591+0000","last_peered":"2023-11-24T07:56:51.452591+0000","last_clean":"2023-11-24T07:56:51.452591+0000","last_became_active":"2023-11-24T07:56:49.992805+0000","last_became_peered":"2023-11-24T07:56:49.992805+0000","last_unstale":"2023-11-24T07:56:51.452591+0000","last_undegraded":"2023-11-24T07:56:51.452591+0000","last_fullsized":"2023-11-24T07:56:51.452591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465851+0000","last_change":"2023-11-24T07:56:49.996222+0000","last_active":"2023-11-24T07:56:51.465851+0000","last_peered":"2023-11-24T07:56:51.465851+0000","last_clean":"2023-11-24T07:56:51.465851+0000","last_became_active":"2023-11-24T07:56:49.995849+0000","last_became_peered":"2023-11-24T07:56:49.995849+0000","last_unstale":"2023-11-24T07:56:51.465851+0000","last_undegraded":"2023-11-24T07:56:51.465851+0000","last_fullsized":"2023-11-24T07:56:51.465851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466448+0000","last_change":"2023-11-24T07:56:50.016330+0000","last_active":"2023-11-24T07:56:51.466448+0000","last_peered":"2023-11-24T07:56:51.466448+0000","last_clean":"2023-11-24T07:56:51.466448+0000","last_became_active":"2023-11-24T07:56:50.016061+0000","last_became_peered":"2023-11-24T07:56:50.016061+0000","last_unstale":"2023-11-24T07:56:51.466448+0000","last_undegraded":"2023-11-24T07:56:51.466448+0000","last_fullsized":"2023-11-24T07:56:51.466448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.711313+0000","last_change":"2023-11-24T07:56:49.995710+0000","last_active":"2023-11-24T07:56:51.711313+0000","last_peered":"2023-11-24T07:56:51.711313+0000","last_clean":"2023-11-24T07:56:51.711313+0000","last_became_active":"2023-11-24T07:56:49.995395+0000","last_became_peered":"2023-11-24T07:56:49.995395+0000","last_unstale":"2023-11-24T07:56:51.711313+0000","last_undegraded":"2023-11-24T07:56:51.711313+0000","last_fullsized":"2023-11-24T07:56:51.711313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:09.056215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988254+0000","last_change":"2023-11-24T07:56:49.987938+0000","last_active":"2023-11-24T07:56:50.988254+0000","last_peered":"2023-11-24T07:56:50.988254+0000","last_clean":"2023-11-24T07:56:50.988254+0000","last_became_active":"2023-11-24T07:56:49.987515+0000","last_became_peered":"2023-11-24T07:56:49.987515+0000","last_unstale":"2023-11-24T07:56:50.988254+0000","last_undegraded":"2023-11-24T07:56:50.988254+0000","last_fullsized":"2023-11-24T07:56:50.988254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:12:55.513445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767141+0000","last_change":"2023-11-24T07:56:49.994082+0000","last_active":"2023-11-24T07:56:51.767141+0000","last_peered":"2023-11-24T07:56:51.767141+0000","last_clean":"2023-11-24T07:56:51.767141+0000","last_became_active":"2023-11-24T07:56:49.993509+0000","last_became_peered":"2023-11-24T07:56:49.993509+0000","last_unstale":"2023-11-24T07:56:51.767141+0000","last_undegraded":"2023-11-24T07:56:51.767141+0000","last_fullsized":"2023-11-24T07:56:51.767141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769687+0000","last_change":"2023-11-24T07:56:49.981227+0000","last_active":"2023-11-24T07:56:51.769687+0000","last_peered":"2023-11-24T07:56:51.769687+0000","last_clean":"2023-11-24T07:56:51.769687+0000","last_became_active":"2023-11-24T07:56:49.980964+0000","last_became_peered":"2023-11-24T07:56:49.980964+0000","last_unstale":"2023-11-24T07:56:51.769687+0000","last_undegraded":"2023-11-24T07:56:51.769687+0000","last_fullsized":"2023-11-24T07:56:51.769687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:12.475852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465915+0000","last_change":"2023-11-24T07:56:50.009118+0000","last_active":"2023-11-24T07:56:51.465915+0000","last_peered":"2023-11-24T07:56:51.465915+0000","last_clean":"2023-11-24T07:56:51.465915+0000","last_became_active":"2023-11-24T07:56:50.008914+0000","last_became_peered":"2023-11-24T07:56:50.008914+0000","last_unstale":"2023-11-24T07:56:51.465915+0000","last_undegraded":"2023-11-24T07:56:51.465915+0000","last_fullsized":"2023-11-24T07:56:51.465915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988096+0000","last_change":"2023-11-24T07:56:49.993617+0000","last_active":"2023-11-24T07:56:50.988096+0000","last_peered":"2023-11-24T07:56:50.988096+0000","last_clean":"2023-11-24T07:56:50.988096+0000","last_became_active":"2023-11-24T07:56:49.993342+0000","last_became_peered":"2023-11-24T07:56:49.993342+0000","last_unstale":"2023-11-24T07:56:50.988096+0000","last_undegraded":"2023-11-24T07:56:50.988096+0000","last_fullsized":"2023-11-24T07:56:50.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.465971+0000","last_change":"2023-11-24T07:56:49.987374+0000","last_active":"2023-11-24T07:56:51.465971+0000","last_peered":"2023-11-24T07:56:51.465971+0000","last_clean":"2023-11-24T07:56:51.465971+0000","last_became_active":"2023-11-24T07:56:49.987072+0000","last_became_peered":"2023-11-24T07:56:49.987072+0000","last_unstale":"2023-11-24T07:56:51.465971+0000","last_undegraded":"2023-11-24T07:56:51.465971+0000","last_fullsized":"2023-11-24T07:56:51.465971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989129+0000","last_change":"2023-11-24T07:56:50.007415+0000","last_active":"2023-11-24T07:56:50.989129+0000","last_peered":"2023-11-24T07:56:50.989129+0000","last_clean":"2023-11-24T07:56:50.989129+0000","last_became_active":"2023-11-24T07:56:50.007143+0000","last_became_peered":"2023-11-24T07:56:50.007143+0000","last_unstale":"2023-11-24T07:56:50.989129+0000","last_undegraded":"2023-11-24T07:56:50.989129+0000","last_fullsized":"2023-11-24T07:56:50.989129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767307+0000","last_change":"2023-11-24T07:56:49.992073+0000","last_active":"2023-11-24T07:56:51.767307+0000","last_peered":"2023-11-24T07:56:51.767307+0000","last_clean":"2023-11-24T07:56:51.767307+0000","last_became_active":"2023-11-24T07:56:49.991751+0000","last_became_peered":"2023-11-24T07:56:49.991751+0000","last_unstale":"2023-11-24T07:56:51.767307+0000","last_undegraded":"2023-11-24T07:56:51.767307+0000","last_fullsized":"2023-11-24T07:56:51.767307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452672+0000","last_change":"2023-11-24T07:56:49.991019+0000","last_active":"2023-11-24T07:56:51.452672+0000","last_peered":"2023-11-24T07:56:51.452672+0000","last_clean":"2023-11-24T07:56:51.452672+0000","last_became_active":"2023-11-24T07:56:49.990710+0000","last_became_peered":"2023-11-24T07:56:49.990710+0000","last_unstale":"2023-11-24T07:56:51.452672+0000","last_undegraded":"2023-11-24T07:56:51.452672+0000","last_fullsized":"2023-11-24T07:56:51.452672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988686+0000","last_change":"2023-11-24T07:56:50.007449+0000","last_active":"2023-11-24T07:56:50.988686+0000","last_peered":"2023-11-24T07:56:50.988686+0000","last_clean":"2023-11-24T07:56:50.988686+0000","last_became_active":"2023-11-24T07:56:50.007205+0000","last_became_peered":"2023-11-24T07:56:50.007205+0000","last_unstale":"2023-11-24T07:56:50.988686+0000","last_undegraded":"2023-11-24T07:56:50.988686+0000","last_fullsized":"2023-11-24T07:56:50.988686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:21:14.710072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769776+0000","last_change":"2023-11-24T07:56:49.991939+0000","last_active":"2023-11-24T07:56:51.769776+0000","last_peered":"2023-11-24T07:56:51.769776+0000","last_clean":"2023-11-24T07:56:51.769776+0000","last_became_active":"2023-11-24T07:56:49.991553+0000","last_became_peered":"2023-11-24T07:56:49.991553+0000","last_unstale":"2023-11-24T07:56:51.769776+0000","last_undegraded":"2023-11-24T07:56:51.769776+0000","last_fullsized":"2023-11-24T07:56:51.769776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466033+0000","last_change":"2023-11-24T07:56:49.996135+0000","last_active":"2023-11-24T07:56:51.466033+0000","last_peered":"2023-11-24T07:56:51.466033+0000","last_clean":"2023-11-24T07:56:51.466033+0000","last_became_active":"2023-11-24T07:56:49.995502+0000","last_became_peered":"2023-11-24T07:56:49.995502+0000","last_unstale":"2023-11-24T07:56:51.466033+0000","last_undegraded":"2023-11-24T07:56:51.466033+0000","last_fullsized":"2023-11-24T07:56:51.466033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.711133+0000","last_change":"2023-11-24T07:56:49.999799+0000","last_active":"2023-11-24T07:56:51.711133+0000","last_peered":"2023-11-24T07:56:51.711133+0000","last_clean":"2023-11-24T07:56:51.711133+0000","last_became_active":"2023-11-24T07:56:49.999461+0000","last_became_peered":"2023-11-24T07:56:49.999461+0000","last_unstale":"2023-11-24T07:56:51.711133+0000","last_undegraded":"2023-11-24T07:56:51.711133+0000","last_fullsized":"2023-11-24T07:56:51.711133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:02.354677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.766985+0000","last_change":"2023-11-24T07:56:50.006284+0000","last_active":"2023-11-24T07:56:51.766985+0000","last_peered":"2023-11-24T07:56:51.766985+0000","last_clean":"2023-11-24T07:56:51.766985+0000","last_became_active":"2023-11-24T07:56:50.005181+0000","last_became_peered":"2023-11-24T07:56:50.005181+0000","last_unstale":"2023-11-24T07:56:51.766985+0000","last_undegraded":"2023-11-24T07:56:51.766985+0000","last_fullsized":"2023-11-24T07:56:51.766985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986518+0000","last_change":"2023-11-24T07:56:49.982685+0000","last_active":"2023-11-24T07:56:50.986518+0000","last_peered":"2023-11-24T07:56:50.986518+0000","last_clean":"2023-11-24T07:56:50.986518+0000","last_became_active":"2023-11-24T07:56:49.982396+0000","last_became_peered":"2023-11-24T07:56:49.982396+0000","last_unstale":"2023-11-24T07:56:50.986518+0000","last_undegraded":"2023-11-24T07:56:50.986518+0000","last_fullsized":"2023-11-24T07:56:50.986518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:36.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988660+0000","last_change":"2023-11-24T07:56:48.997228+0000","last_active":"2023-11-24T07:56:50.988660+0000","last_peered":"2023-11-24T07:56:50.988660+0000","last_clean":"2023-11-24T07:56:50.988660+0000","last_became_active":"2023-11-24T07:56:48.996544+0000","last_became_peered":"2023-11-24T07:56:48.996544+0000","last_unstale":"2023-11-24T07:56:50.988660+0000","last_undegraded":"2023-11-24T07:56:50.988660+0000","last_fullsized":"2023-11-24T07:56:50.988660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769843+0000","last_change":"2023-11-24T07:56:49.994392+0000","last_active":"2023-11-24T07:56:51.769843+0000","last_peered":"2023-11-24T07:56:51.769843+0000","last_clean":"2023-11-24T07:56:51.769843+0000","last_became_active":"2023-11-24T07:56:49.991942+0000","last_became_peered":"2023-11-24T07:56:49.991942+0000","last_unstale":"2023-11-24T07:56:51.769843+0000","last_undegraded":"2023-11-24T07:56:51.769843+0000","last_fullsized":"2023-11-24T07:56:51.769843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262002+0000","last_change":"2023-11-24T07:56:48.990750+0000","last_active":"2023-11-24T07:56:51.262002+0000","last_peered":"2023-11-24T07:56:51.262002+0000","last_clean":"2023-11-24T07:56:51.262002+0000","last_became_active":"2023-11-24T07:56:48.990336+0000","last_became_peered":"2023-11-24T07:56:48.990336+0000","last_unstale":"2023-11-24T07:56:51.262002+0000","last_undegraded":"2023-11-24T07:56:51.262002+0000","last_fullsized":"2023-11-24T07:56:51.262002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988186+0000","last_change":"2023-11-24T07:56:48.996558+0000","last_active":"2023-11-24T07:56:50.988186+0000","last_peered":"2023-11-24T07:56:50.988186+0000","last_clean":"2023-11-24T07:56:50.988186+0000","last_became_active":"2023-11-24T07:56:48.996277+0000","last_became_peered":"2023-11-24T07:56:48.996277+0000","last_unstale":"2023-11-24T07:56:50.988186+0000","last_undegraded":"2023-11-24T07:56:50.988186+0000","last_fullsized":"2023-11-24T07:56:50.988186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988149+0000","last_change":"2023-11-24T07:56:49.990169+0000","last_active":"2023-11-24T07:56:50.988149+0000","last_peered":"2023-11-24T07:56:50.988149+0000","last_clean":"2023-11-24T07:56:50.988149+0000","last_became_active":"2023-11-24T07:56:49.989887+0000","last_became_peered":"2023-11-24T07:56:49.989887+0000","last_unstale":"2023-11-24T07:56:50.988149+0000","last_undegraded":"2023-11-24T07:56:50.988149+0000","last_fullsized":"2023-11-24T07:56:50.988149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268528+0000","last_change":"2023-11-24T07:56:48.988849+0000","last_active":"2023-11-24T07:56:51.268528+0000","last_peered":"2023-11-24T07:56:51.268528+0000","last_clean":"2023-11-24T07:56:51.268528+0000","last_became_active":"2023-11-24T07:56:48.988481+0000","last_became_peered":"2023-11-24T07:56:48.988481+0000","last_unstale":"2023-11-24T07:56:51.268528+0000","last_undegraded":"2023-11-24T07:56:51.268528+0000","last_fullsized":"2023-11-24T07:56:51.268528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452600+0000","last_change":"2023-11-24T07:56:49.998134+0000","last_active":"2023-11-24T07:56:51.452600+0000","last_peered":"2023-11-24T07:56:51.452600+0000","last_clean":"2023-11-24T07:56:51.452600+0000","last_became_active":"2023-11-24T07:56:49.997733+0000","last_became_peered":"2023-11-24T07:56:49.997733+0000","last_unstale":"2023-11-24T07:56:51.452600+0000","last_undegraded":"2023-11-24T07:56:51.452600+0000","last_fullsized":"2023-11-24T07:56:51.452600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262127+0000","last_change":"2023-11-24T07:56:48.996333+0000","last_active":"2023-11-24T07:56:51.262127+0000","last_peered":"2023-11-24T07:56:51.262127+0000","last_clean":"2023-11-24T07:56:51.262127+0000","last_became_active":"2023-11-24T07:56:48.995991+0000","last_became_peered":"2023-11-24T07:56:48.995991+0000","last_unstale":"2023-11-24T07:56:51.262127+0000","last_undegraded":"2023-11-24T07:56:51.262127+0000","last_fullsized":"2023-11-24T07:56:51.262127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466407+0000","last_change":"2023-11-24T07:56:50.009044+0000","last_active":"2023-11-24T07:56:51.466407+0000","last_peered":"2023-11-24T07:56:51.466407+0000","last_clean":"2023-11-24T07:56:51.466407+0000","last_became_active":"2023-11-24T07:56:50.008572+0000","last_became_peered":"2023-11-24T07:56:50.008572+0000","last_unstale":"2023-11-24T07:56:51.466407+0000","last_undegraded":"2023-11-24T07:56:51.466407+0000","last_fullsized":"2023-11-24T07:56:51.466407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268746+0000","last_change":"2023-11-24T07:56:48.994794+0000","last_active":"2023-11-24T07:56:51.268746+0000","last_peered":"2023-11-24T07:56:51.268746+0000","last_clean":"2023-11-24T07:56:51.268746+0000","last_became_active":"2023-11-24T07:56:48.994353+0000","last_became_peered":"2023-11-24T07:56:48.994353+0000","last_unstale":"2023-11-24T07:56:51.268746+0000","last_undegraded":"2023-11-24T07:56:51.268746+0000","last_fullsized":"2023-11-24T07:56:51.268746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:04.278869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.770004+0000","last_change":"2023-11-24T07:56:49.999054+0000","last_active":"2023-11-24T07:56:51.770004+0000","last_peered":"2023-11-24T07:56:51.770004+0000","last_clean":"2023-11-24T07:56:51.770004+0000","last_became_active":"2023-11-24T07:56:49.998590+0000","last_became_peered":"2023-11-24T07:56:49.998590+0000","last_unstale":"2023-11-24T07:56:51.770004+0000","last_undegraded":"2023-11-24T07:56:51.770004+0000","last_fullsized":"2023-11-24T07:56:51.770004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:48.465996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273926+0000","last_change":"2023-11-24T07:56:49.000118+0000","last_active":"2023-11-24T07:56:51.273926+0000","last_peered":"2023-11-24T07:56:51.273926+0000","last_clean":"2023-11-24T07:56:51.273926+0000","last_became_active":"2023-11-24T07:56:48.999794+0000","last_became_peered":"2023-11-24T07:56:48.999794+0000","last_unstale":"2023-11-24T07:56:51.273926+0000","last_undegraded":"2023-11-24T07:56:51.273926+0000","last_fullsized":"2023-11-24T07:56:51.273926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986815+0000","last_change":"2023-11-24T07:56:49.989959+0000","last_active":"2023-11-24T07:56:50.986815+0000","last_peered":"2023-11-24T07:56:50.986815+0000","last_clean":"2023-11-24T07:56:50.986815+0000","last_became_active":"2023-11-24T07:56:49.989687+0000","last_became_peered":"2023-11-24T07:56:49.989687+0000","last_unstale":"2023-11-24T07:56:50.986815+0000","last_undegraded":"2023-11-24T07:56:50.986815+0000","last_fullsized":"2023-11-24T07:56:50.986815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:00.653464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262043+0000","last_change":"2023-11-24T07:56:48.988881+0000","last_active":"2023-11-24T07:56:51.262043+0000","last_peered":"2023-11-24T07:56:51.262043+0000","last_clean":"2023-11-24T07:56:51.262043+0000","last_became_active":"2023-11-24T07:56:48.988590+0000","last_became_peered":"2023-11-24T07:56:48.988590+0000","last_unstale":"2023-11-24T07:56:51.262043+0000","last_undegraded":"2023-11-24T07:56:51.262043+0000","last_fullsized":"2023-11-24T07:56:51.262043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987903+0000","last_change":"2023-11-24T07:56:49.985992+0000","last_active":"2023-11-24T07:56:50.987903+0000","last_peered":"2023-11-24T07:56:50.987903+0000","last_clean":"2023-11-24T07:56:50.987903+0000","last_became_active":"2023-11-24T07:56:49.985719+0000","last_became_peered":"2023-11-24T07:56:49.985719+0000","last_unstale":"2023-11-24T07:56:50.987903+0000","last_undegraded":"2023-11-24T07:56:50.987903+0000","last_fullsized":"2023-11-24T07:56:50.987903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.272371+0000","last_change":"2023-11-24T07:56:48.986496+0000","last_active":"2023-11-24T07:56:51.272371+0000","last_peered":"2023-11-24T07:56:51.272371+0000","last_clean":"2023-11-24T07:56:51.272371+0000","last_became_active":"2023-11-24T07:56:48.986172+0000","last_became_peered":"2023-11-24T07:56:48.986172+0000","last_unstale":"2023-11-24T07:56:51.272371+0000","last_undegraded":"2023-11-24T07:56:51.272371+0000","last_fullsized":"2023-11-24T07:56:51.272371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769754+0000","last_change":"2023-11-24T07:56:49.979739+0000","last_active":"2023-11-24T07:56:51.769754+0000","last_peered":"2023-11-24T07:56:51.769754+0000","last_clean":"2023-11-24T07:56:51.769754+0000","last_became_active":"2023-11-24T07:56:49.979473+0000","last_became_peered":"2023-11-24T07:56:49.979473+0000","last_unstale":"2023-11-24T07:56:51.769754+0000","last_undegraded":"2023-11-24T07:56:51.769754+0000","last_fullsized":"2023-11-24T07:56:51.769754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:42:05.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268565+0000","last_change":"2023-11-24T07:56:48.989819+0000","last_active":"2023-11-24T07:56:51.268565+0000","last_peered":"2023-11-24T07:56:51.268565+0000","last_clean":"2023-11-24T07:56:51.268565+0000","last_became_active":"2023-11-24T07:56:48.989226+0000","last_became_peered":"2023-11-24T07:56:48.989226+0000","last_unstale":"2023-11-24T07:56:51.268565+0000","last_undegraded":"2023-11-24T07:56:51.268565+0000","last_fullsized":"2023-11-24T07:56:51.268565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:44.234559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987828+0000","last_change":"2023-11-24T07:56:49.990806+0000","last_active":"2023-11-24T07:56:50.987828+0000","last_peered":"2023-11-24T07:56:50.987828+0000","last_clean":"2023-11-24T07:56:50.987828+0000","last_became_active":"2023-11-24T07:56:49.990478+0000","last_became_peered":"2023-11-24T07:56:49.990478+0000","last_unstale":"2023-11-24T07:56:50.987828+0000","last_undegraded":"2023-11-24T07:56:50.987828+0000","last_fullsized":"2023-11-24T07:56:50.987828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.261967+0000","last_change":"2023-11-24T07:56:48.987232+0000","last_active":"2023-11-24T07:56:51.261967+0000","last_peered":"2023-11-24T07:56:51.261967+0000","last_clean":"2023-11-24T07:56:51.261967+0000","last_became_active":"2023-11-24T07:56:48.986874+0000","last_became_peered":"2023-11-24T07:56:48.986874+0000","last_unstale":"2023-11-24T07:56:51.261967+0000","last_undegraded":"2023-11-24T07:56:51.261967+0000","last_fullsized":"2023-11-24T07:56:51.261967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767117+0000","last_change":"2023-11-24T07:56:50.005621+0000","last_active":"2023-11-24T07:56:51.767117+0000","last_peered":"2023-11-24T07:56:51.767117+0000","last_clean":"2023-11-24T07:56:51.767117+0000","last_became_active":"2023-11-24T07:56:50.004796+0000","last_became_peered":"2023-11-24T07:56:50.004796+0000","last_unstale":"2023-11-24T07:56:51.767117+0000","last_undegraded":"2023-11-24T07:56:51.767117+0000","last_fullsized":"2023-11-24T07:56:51.767117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:25.487206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273588+0000","last_change":"2023-11-24T07:56:48.982818+0000","last_active":"2023-11-24T07:56:51.273588+0000","last_peered":"2023-11-24T07:56:51.273588+0000","last_clean":"2023-11-24T07:56:51.273588+0000","last_became_active":"2023-11-24T07:56:48.982473+0000","last_became_peered":"2023-11-24T07:56:48.982473+0000","last_unstale":"2023-11-24T07:56:51.273588+0000","last_undegraded":"2023-11-24T07:56:51.273588+0000","last_fullsized":"2023-11-24T07:56:51.273588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:40.373215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987624+0000","last_change":"2023-11-24T07:56:49.990672+0000","last_active":"2023-11-24T07:56:50.987624+0000","last_peered":"2023-11-24T07:56:50.987624+0000","last_clean":"2023-11-24T07:56:50.987624+0000","last_became_active":"2023-11-24T07:56:49.990376+0000","last_became_peered":"2023-11-24T07:56:49.990376+0000","last_unstale":"2023-11-24T07:56:50.987624+0000","last_undegraded":"2023-11-24T07:56:50.987624+0000","last_fullsized":"2023-11-24T07:56:50.987624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:27:06.459558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986880+0000","last_change":"2023-11-24T07:56:48.988508+0000","last_active":"2023-11-24T07:56:50.986880+0000","last_peered":"2023-11-24T07:56:50.986880+0000","last_clean":"2023-11-24T07:56:50.986880+0000","last_became_active":"2023-11-24T07:56:48.988087+0000","last_became_peered":"2023-11-24T07:56:48.988087+0000","last_unstale":"2023-11-24T07:56:50.986880+0000","last_undegraded":"2023-11-24T07:56:50.986880+0000","last_fullsized":"2023-11-24T07:56:50.986880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:06.606043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987995+0000","last_change":"2023-11-24T07:56:49.990816+0000","last_active":"2023-11-24T07:56:50.987995+0000","last_peered":"2023-11-24T07:56:50.987995+0000","last_clean":"2023-11-24T07:56:50.987995+0000","last_became_active":"2023-11-24T07:56:49.990509+0000","last_became_peered":"2023-11-24T07:56:49.990509+0000","last_unstale":"2023-11-24T07:56:50.987995+0000","last_undegraded":"2023-11-24T07:56:50.987995+0000","last_fullsized":"2023-11-24T07:56:50.987995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273661+0000","last_change":"2023-11-24T07:56:48.992645+0000","last_active":"2023-11-24T07:56:51.273661+0000","last_peered":"2023-11-24T07:56:51.273661+0000","last_clean":"2023-11-24T07:56:51.273661+0000","last_became_active":"2023-11-24T07:56:48.992283+0000","last_became_peered":"2023-11-24T07:56:48.992283+0000","last_unstale":"2023-11-24T07:56:51.273661+0000","last_undegraded":"2023-11-24T07:56:51.273661+0000","last_fullsized":"2023-11-24T07:56:51.273661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:53.516529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988381+0000","last_change":"2023-11-24T07:56:49.993271+0000","last_active":"2023-11-24T07:56:50.988381+0000","last_peered":"2023-11-24T07:56:50.988381+0000","last_clean":"2023-11-24T07:56:50.988381+0000","last_became_active":"2023-11-24T07:56:49.992353+0000","last_became_peered":"2023-11-24T07:56:49.992353+0000","last_unstale":"2023-11-24T07:56:50.988381+0000","last_undegraded":"2023-11-24T07:56:50.988381+0000","last_fullsized":"2023-11-24T07:56:50.988381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:59.074191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273981+0000","last_change":"2023-11-24T07:56:48.984821+0000","last_active":"2023-11-24T07:56:51.273981+0000","last_peered":"2023-11-24T07:56:51.273981+0000","last_clean":"2023-11-24T07:56:51.273981+0000","last_became_active":"2023-11-24T07:56:48.984545+0000","last_became_peered":"2023-11-24T07:56:48.984545+0000","last_unstale":"2023-11-24T07:56:51.273981+0000","last_undegraded":"2023-11-24T07:56:51.273981+0000","last_fullsized":"2023-11-24T07:56:51.273981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466212+0000","last_change":"2023-11-24T07:56:49.994668+0000","last_active":"2023-11-24T07:56:51.466212+0000","last_peered":"2023-11-24T07:56:51.466212+0000","last_clean":"2023-11-24T07:56:51.466212+0000","last_became_active":"2023-11-24T07:56:49.993993+0000","last_became_peered":"2023-11-24T07:56:49.993993+0000","last_unstale":"2023-11-24T07:56:51.466212+0000","last_undegraded":"2023-11-24T07:56:51.466212+0000","last_fullsized":"2023-11-24T07:56:51.466212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:51.259679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273642+0000","last_change":"2023-11-24T07:56:48.997388+0000","last_active":"2023-11-24T07:56:51.273642+0000","last_peered":"2023-11-24T07:56:51.273642+0000","last_clean":"2023-11-24T07:56:51.273642+0000","last_became_active":"2023-11-24T07:56:48.997143+0000","last_became_peered":"2023-11-24T07:56:48.997143+0000","last_unstale":"2023-11-24T07:56:51.273642+0000","last_undegraded":"2023-11-24T07:56:51.273642+0000","last_fullsized":"2023-11-24T07:56:51.273642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988126+0000","last_change":"2023-11-24T07:56:50.017444+0000","last_active":"2023-11-24T07:56:50.988126+0000","last_peered":"2023-11-24T07:56:50.988126+0000","last_clean":"2023-11-24T07:56:50.988126+0000","last_became_active":"2023-11-24T07:56:50.017218+0000","last_became_peered":"2023-11-24T07:56:50.017218+0000","last_unstale":"2023-11-24T07:56:50.988126+0000","last_undegraded":"2023-11-24T07:56:50.988126+0000","last_fullsized":"2023-11-24T07:56:50.988126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:47.123912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:49.973044+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:56:49.973044+0000","last_peered":"2023-11-24T07:56:49.973044+0000","last_clean":"2023-11-24T07:56:49.973044+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:56:49.973044+0000","last_undegraded":"2023-11-24T07:56:49.973044+0000","last_fullsized":"2023-11-24T07:56:49.973044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268608+0000","last_change":"2023-11-24T07:56:48.992283+0000","last_active":"2023-11-24T07:56:51.268608+0000","last_peered":"2023-11-24T07:56:51.268608+0000","last_clean":"2023-11-24T07:56:51.268608+0000","last_became_active":"2023-11-24T07:56:48.991808+0000","last_became_peered":"2023-11-24T07:56:48.991808+0000","last_unstale":"2023-11-24T07:56:51.268608+0000","last_undegraded":"2023-11-24T07:56:51.268608+0000","last_fullsized":"2023-11-24T07:56:51.268608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:24.480996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988271+0000","last_change":"2023-11-24T07:56:50.020101+0000","last_active":"2023-11-24T07:56:50.988271+0000","last_peered":"2023-11-24T07:56:50.988271+0000","last_clean":"2023-11-24T07:56:50.988271+0000","last_became_active":"2023-11-24T07:56:50.019553+0000","last_became_peered":"2023-11-24T07:56:50.019553+0000","last_unstale":"2023-11-24T07:56:50.988271+0000","last_undegraded":"2023-11-24T07:56:50.988271+0000","last_fullsized":"2023-11-24T07:56:50.988271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987627+0000","last_change":"2023-11-24T07:56:48.982233+0000","last_active":"2023-11-24T07:56:50.987627+0000","last_peered":"2023-11-24T07:56:50.987627+0000","last_clean":"2023-11-24T07:56:50.987627+0000","last_became_active":"2023-11-24T07:56:48.981854+0000","last_became_peered":"2023-11-24T07:56:48.981854+0000","last_unstale":"2023-11-24T07:56:50.987627+0000","last_undegraded":"2023-11-24T07:56:50.987627+0000","last_fullsized":"2023-11-24T07:56:50.987627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769576+0000","last_change":"2023-11-24T07:56:49.983532+0000","last_active":"2023-11-24T07:56:51.769576+0000","last_peered":"2023-11-24T07:56:51.769576+0000","last_clean":"2023-11-24T07:56:51.769576+0000","last_became_active":"2023-11-24T07:56:49.983242+0000","last_became_peered":"2023-11-24T07:56:49.983242+0000","last_unstale":"2023-11-24T07:56:51.769576+0000","last_undegraded":"2023-11-24T07:56:51.769576+0000","last_fullsized":"2023-11-24T07:56:51.769576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:48.183813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273612+0000","last_change":"2023-11-24T07:56:48.992743+0000","last_active":"2023-11-24T07:56:51.273612+0000","last_peered":"2023-11-24T07:56:51.273612+0000","last_clean":"2023-11-24T07:56:51.273612+0000","last_became_active":"2023-11-24T07:56:48.992300+0000","last_became_peered":"2023-11-24T07:56:48.992300+0000","last_unstale":"2023-11-24T07:56:51.273612+0000","last_undegraded":"2023-11-24T07:56:51.273612+0000","last_fullsized":"2023-11-24T07:56:51.273612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:35.559097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452592+0000","last_change":"2023-11-24T07:56:49.981866+0000","last_active":"2023-11-24T07:56:51.452592+0000","last_peered":"2023-11-24T07:56:51.452592+0000","last_clean":"2023-11-24T07:56:51.452592+0000","last_became_active":"2023-11-24T07:56:49.981342+0000","last_became_peered":"2023-11-24T07:56:49.981342+0000","last_unstale":"2023-11-24T07:56:51.452592+0000","last_undegraded":"2023-11-24T07:56:51.452592+0000","last_fullsized":"2023-11-24T07:56:51.452592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.268592+0000","last_change":"2023-11-24T07:56:48.993830+0000","last_active":"2023-11-24T07:56:51.268592+0000","last_peered":"2023-11-24T07:56:51.268592+0000","last_clean":"2023-11-24T07:56:51.268592+0000","last_became_active":"2023-11-24T07:56:48.991880+0000","last_became_peered":"2023-11-24T07:56:48.991880+0000","last_unstale":"2023-11-24T07:56:51.268592+0000","last_undegraded":"2023-11-24T07:56:51.268592+0000","last_fullsized":"2023-11-24T07:56:51.268592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986711+0000","last_change":"2023-11-24T07:56:50.002741+0000","last_active":"2023-11-24T07:56:50.986711+0000","last_peered":"2023-11-24T07:56:50.986711+0000","last_clean":"2023-11-24T07:56:50.986711+0000","last_became_active":"2023-11-24T07:56:49.994282+0000","last_became_peered":"2023-11-24T07:56:49.994282+0000","last_unstale":"2023-11-24T07:56:50.986711+0000","last_undegraded":"2023-11-24T07:56:50.986711+0000","last_fullsized":"2023-11-24T07:56:50.986711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:41:54.522739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273906+0000","last_change":"2023-11-24T07:56:48.988654+0000","last_active":"2023-11-24T07:56:51.273906+0000","last_peered":"2023-11-24T07:56:51.273906+0000","last_clean":"2023-11-24T07:56:51.273906+0000","last_became_active":"2023-11-24T07:56:48.988250+0000","last_became_peered":"2023-11-24T07:56:48.988250+0000","last_unstale":"2023-11-24T07:56:51.273906+0000","last_undegraded":"2023-11-24T07:56:51.273906+0000","last_fullsized":"2023-11-24T07:56:51.273906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:44.773715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466296+0000","last_change":"2023-11-24T07:56:50.001254+0000","last_active":"2023-11-24T07:56:51.466296+0000","last_peered":"2023-11-24T07:56:51.466296+0000","last_clean":"2023-11-24T07:56:51.466296+0000","last_became_active":"2023-11-24T07:56:49.996268+0000","last_became_peered":"2023-11-24T07:56:49.996268+0000","last_unstale":"2023-11-24T07:56:51.466296+0000","last_undegraded":"2023-11-24T07:56:51.466296+0000","last_fullsized":"2023-11-24T07:56:51.466296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:44.365715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988286+0000","last_change":"2023-11-24T07:56:48.991678+0000","last_active":"2023-11-24T07:56:50.988286+0000","last_peered":"2023-11-24T07:56:50.988286+0000","last_clean":"2023-11-24T07:56:50.988286+0000","last_became_active":"2023-11-24T07:56:48.991306+0000","last_became_peered":"2023-11-24T07:56:48.991306+0000","last_unstale":"2023-11-24T07:56:50.988286+0000","last_undegraded":"2023-11-24T07:56:50.988286+0000","last_fullsized":"2023-11-24T07:56:50.988286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:52.750127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452686+0000","last_change":"2023-11-24T07:56:49.983208+0000","last_active":"2023-11-24T07:56:51.452686+0000","last_peered":"2023-11-24T07:56:51.452686+0000","last_clean":"2023-11-24T07:56:51.452686+0000","last_became_active":"2023-11-24T07:56:49.982720+0000","last_became_peered":"2023-11-24T07:56:49.982720+0000","last_unstale":"2023-11-24T07:56:51.452686+0000","last_undegraded":"2023-11-24T07:56:51.452686+0000","last_fullsized":"2023-11-24T07:56:51.452686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.452823+0000","last_change":"2023-11-24T07:56:48.993105+0000","last_active":"2023-11-24T07:56:51.452823+0000","last_peered":"2023-11-24T07:56:51.452823+0000","last_clean":"2023-11-24T07:56:51.452823+0000","last_became_active":"2023-11-24T07:56:48.991445+0000","last_became_peered":"2023-11-24T07:56:48.991445+0000","last_unstale":"2023-11-24T07:56:51.452823+0000","last_undegraded":"2023-11-24T07:56:51.452823+0000","last_fullsized":"2023-11-24T07:56:51.452823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.989165+0000","last_change":"2023-11-24T07:56:49.986008+0000","last_active":"2023-11-24T07:56:50.989165+0000","last_peered":"2023-11-24T07:56:50.989165+0000","last_clean":"2023-11-24T07:56:50.989165+0000","last_became_active":"2023-11-24T07:56:49.985648+0000","last_became_peered":"2023-11-24T07:56:49.985648+0000","last_unstale":"2023-11-24T07:56:50.989165+0000","last_undegraded":"2023-11-24T07:56:50.989165+0000","last_fullsized":"2023-11-24T07:56:50.989165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.262140+0000","last_change":"2023-11-24T07:56:48.995945+0000","last_active":"2023-11-24T07:56:51.262140+0000","last_peered":"2023-11-24T07:56:51.262140+0000","last_clean":"2023-11-24T07:56:51.262140+0000","last_became_active":"2023-11-24T07:56:48.995477+0000","last_became_peered":"2023-11-24T07:56:48.995477+0000","last_unstale":"2023-11-24T07:56:51.262140+0000","last_undegraded":"2023-11-24T07:56:51.262140+0000","last_fullsized":"2023-11-24T07:56:51.262140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:47.177603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769818+0000","last_change":"2023-11-24T07:56:49.995099+0000","last_active":"2023-11-24T07:56:51.769818+0000","last_peered":"2023-11-24T07:56:51.769818+0000","last_clean":"2023-11-24T07:56:51.769818+0000","last_became_active":"2023-11-24T07:56:49.994601+0000","last_became_peered":"2023-11-24T07:56:49.994601+0000","last_unstale":"2023-11-24T07:56:51.769818+0000","last_undegraded":"2023-11-24T07:56:51.769818+0000","last_fullsized":"2023-11-24T07:56:51.769818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:45.240769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987462+0000","last_change":"2023-11-24T07:56:48.988789+0000","last_active":"2023-11-24T07:56:50.987462+0000","last_peered":"2023-11-24T07:56:50.987462+0000","last_clean":"2023-11-24T07:56:50.987462+0000","last_became_active":"2023-11-24T07:56:48.988504+0000","last_became_peered":"2023-11-24T07:56:48.988504+0000","last_unstale":"2023-11-24T07:56:50.987462+0000","last_undegraded":"2023-11-24T07:56:50.987462+0000","last_fullsized":"2023-11-24T07:56:50.987462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.986477+0000","last_change":"2023-11-24T07:56:49.988759+0000","last_active":"2023-11-24T07:56:50.986477+0000","last_peered":"2023-11-24T07:56:50.986477+0000","last_clean":"2023-11-24T07:56:50.986477+0000","last_became_active":"2023-11-24T07:56:49.984052+0000","last_became_peered":"2023-11-24T07:56:49.984052+0000","last_unstale":"2023-11-24T07:56:50.986477+0000","last_undegraded":"2023-11-24T07:56:50.986477+0000","last_fullsized":"2023-11-24T07:56:50.986477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:41.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273880+0000","last_change":"2023-11-24T07:56:48.985064+0000","last_active":"2023-11-24T07:56:51.273880+0000","last_peered":"2023-11-24T07:56:51.273880+0000","last_clean":"2023-11-24T07:56:51.273880+0000","last_became_active":"2023-11-24T07:56:48.984182+0000","last_became_peered":"2023-11-24T07:56:48.984182+0000","last_unstale":"2023-11-24T07:56:51.273880+0000","last_undegraded":"2023-11-24T07:56:51.273880+0000","last_fullsized":"2023-11-24T07:56:51.273880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:08.996477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988201+0000","last_change":"2023-11-24T07:56:49.993700+0000","last_active":"2023-11-24T07:56:50.988201+0000","last_peered":"2023-11-24T07:56:50.988201+0000","last_clean":"2023-11-24T07:56:50.988201+0000","last_became_active":"2023-11-24T07:56:49.993441+0000","last_became_peered":"2023-11-24T07:56:49.993441+0000","last_unstale":"2023-11-24T07:56:50.988201+0000","last_undegraded":"2023-11-24T07:56:50.988201+0000","last_fullsized":"2023-11-24T07:56:50.988201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:50:21.156097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.273889+0000","last_change":"2023-11-24T07:56:48.990448+0000","last_active":"2023-11-24T07:56:51.273889+0000","last_peered":"2023-11-24T07:56:51.273889+0000","last_clean":"2023-11-24T07:56:51.273889+0000","last_became_active":"2023-11-24T07:56:48.990125+0000","last_became_peered":"2023-11-24T07:56:48.990125+0000","last_unstale":"2023-11-24T07:56:51.273889+0000","last_undegraded":"2023-11-24T07:56:51.273889+0000","last_fullsized":"2023-11-24T07:56:51.273889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988606+0000","last_change":"2023-11-24T07:56:49.996725+0000","last_active":"2023-11-24T07:56:50.988606+0000","last_peered":"2023-11-24T07:56:50.988606+0000","last_clean":"2023-11-24T07:56:50.988606+0000","last_became_active":"2023-11-24T07:56:49.996362+0000","last_became_peered":"2023-11-24T07:56:49.996362+0000","last_unstale":"2023-11-24T07:56:50.988606+0000","last_undegraded":"2023-11-24T07:56:50.988606+0000","last_fullsized":"2023-11-24T07:56:50.988606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:26.276288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987884+0000","last_change":"2023-11-24T07:56:48.991238+0000","last_active":"2023-11-24T07:56:50.987884+0000","last_peered":"2023-11-24T07:56:50.987884+0000","last_clean":"2023-11-24T07:56:50.987884+0000","last_became_active":"2023-11-24T07:56:48.990808+0000","last_became_peered":"2023-11-24T07:56:48.990808+0000","last_unstale":"2023-11-24T07:56:50.987884+0000","last_undegraded":"2023-11-24T07:56:50.987884+0000","last_fullsized":"2023-11-24T07:56:50.987884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:47.459786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.767034+0000","last_change":"2023-11-24T07:56:49.992018+0000","last_active":"2023-11-24T07:56:51.767034+0000","last_peered":"2023-11-24T07:56:51.767034+0000","last_clean":"2023-11-24T07:56:51.767034+0000","last_became_active":"2023-11-24T07:56:49.990675+0000","last_became_peered":"2023-11-24T07:56:49.990675+0000","last_unstale":"2023-11-24T07:56:51.767034+0000","last_undegraded":"2023-11-24T07:56:51.767034+0000","last_fullsized":"2023-11-24T07:56:51.767034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:43:53.756337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466285+0000","last_change":"2023-11-24T07:56:50.009926+0000","last_active":"2023-11-24T07:56:51.466285+0000","last_peered":"2023-11-24T07:56:51.466285+0000","last_clean":"2023-11-24T07:56:51.466285+0000","last_became_active":"2023-11-24T07:56:50.009644+0000","last_became_peered":"2023-11-24T07:56:50.009644+0000","last_unstale":"2023-11-24T07:56:51.466285+0000","last_undegraded":"2023-11-24T07:56:51.466285+0000","last_fullsized":"2023-11-24T07:56:51.466285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:04:51.647758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.987753+0000","last_change":"2023-11-24T07:56:48.995707+0000","last_active":"2023-11-24T07:56:50.987753+0000","last_peered":"2023-11-24T07:56:50.987753+0000","last_clean":"2023-11-24T07:56:50.987753+0000","last_became_active":"2023-11-24T07:56:48.994686+0000","last_became_peered":"2023-11-24T07:56:48.994686+0000","last_unstale":"2023-11-24T07:56:50.987753+0000","last_undegraded":"2023-11-24T07:56:50.987753+0000","last_fullsized":"2023-11-24T07:56:50.987753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:59.647254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.466129+0000","last_change":"2023-11-24T07:56:49.999352+0000","last_active":"2023-11-24T07:56:51.466129+0000","last_peered":"2023-11-24T07:56:51.466129+0000","last_clean":"2023-11-24T07:56:51.466129+0000","last_became_active":"2023-11-24T07:56:49.998790+0000","last_became_peered":"2023-11-24T07:56:49.998790+0000","last_unstale":"2023-11-24T07:56:51.466129+0000","last_undegraded":"2023-11-24T07:56:51.466129+0000","last_fullsized":"2023-11-24T07:56:51.466129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:11.672467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988009+0000","last_change":"2023-11-24T07:56:48.994077+0000","last_active":"2023-11-24T07:56:50.988009+0000","last_peered":"2023-11-24T07:56:50.988009+0000","last_clean":"2023-11-24T07:56:50.988009+0000","last_became_active":"2023-11-24T07:56:48.993737+0000","last_became_peered":"2023-11-24T07:56:48.993737+0000","last_unstale":"2023-11-24T07:56:50.988009+0000","last_undegraded":"2023-11-24T07:56:50.988009+0000","last_fullsized":"2023-11-24T07:56:50.988009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:11.469642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.769964+0000","last_change":"2023-11-24T07:56:50.020056+0000","last_active":"2023-11-24T07:56:51.769964+0000","last_peered":"2023-11-24T07:56:51.769964+0000","last_clean":"2023-11-24T07:56:51.769964+0000","last_became_active":"2023-11-24T07:56:50.019400+0000","last_became_peered":"2023-11-24T07:56:50.019400+0000","last_unstale":"2023-11-24T07:56:51.769964+0000","last_undegraded":"2023-11-24T07:56:51.769964+0000","last_fullsized":"2023-11-24T07:56:51.769964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:48.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988991+0000","last_change":"2023-11-24T07:56:48.995621+0000","last_active":"2023-11-24T07:56:50.988991+0000","last_peered":"2023-11-24T07:56:50.988991+0000","last_clean":"2023-11-24T07:56:50.988991+0000","last_became_active":"2023-11-24T07:56:48.995263+0000","last_became_peered":"2023-11-24T07:56:48.995263+0000","last_unstale":"2023-11-24T07:56:50.988991+0000","last_undegraded":"2023-11-24T07:56:50.988991+0000","last_fullsized":"2023-11-24T07:56:50.988991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:08.050005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T07:56:50.988856+0000","last_change":"2023-11-24T07:56:49.997265+0000","last_active":"2023-11-24T07:56:50.988856+0000","last_peered":"2023-11-24T07:56:50.988856+0000","last_clean":"2023-11-24T07:56:50.988856+0000","last_became_active":"2023-11-24T07:56:49.996951+0000","last_became_peered":"2023-11-24T07:56:49.996951+0000","last_unstale":"2023-11-24T07:56:50.988856+0000","last_undegraded":"2023-11-24T07:56:50.988856+0000","last_fullsized":"2023-11-24T07:56:50.988856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:48.955157+0000","last_clean_scrub_stamp":"2023-11-24T07:56:48.955157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:04.249316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T07:56:51.272488+0000","last_change":"2023-11-24T07:56:48.997262+0000","last_active":"2023-11-24T07:56:51.272488+0000","last_peered":"2023-11-24T07:56:51.272488+0000","last_clean":"2023-11-24T07:56:51.272488+0000","last_became_active":"2023-11-24T07:56:48.996927+0000","last_became_peered":"2023-11-24T07:56:48.996927+0000","last_unstale":"2023-11-24T07:56:51.272488+0000","last_undegraded":"2023-11-24T07:56:51.272488+0000","last_fullsized":"2023-11-24T07:56:51.272488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:47.948947+0000","last_clean_scrub_stamp":"2023-11-24T07:56:47.948947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:01.348467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":69981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":69891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7810000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6660000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1420000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":70051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:56:59.163 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T07:56:59.163 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T07:56:59.164 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T07:56:59.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T07:56:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 Processor -- start 2023-11-24T07:56:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 -- start start 2023-11-24T07:56:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 0x7fa0740cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0740cf1b0 0x7fa0740cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740d12e0 con 0x7fa0740d02f0 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740d07a0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa07c0ea640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740d15c0 con 0x7fa07415d530 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0740cf1b0 0x7fa0740cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0740cf1b0 0x7fa0740cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57472/0 (socket says 172.21.15.5:57472) 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 -- 172.21.15.5:0/1517839318 learned_addr learned my addr 172.21.15.5:0/1517839318 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079e86640 1 --2- 172.21.15.5:0/1517839318 >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 0x7fa0740cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 -- 172.21.15.5:0/1517839318 >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 msgr2=0x7fa0740cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:59.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 --2- 172.21.15.5:0/1517839318 >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 0x7fa0740cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 -- 172.21.15.5:0/1517839318 >> v1:172.21.15.102:6789/0 conn(0x7fa0740d02f0 legacy=0x7fa0741611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079685640 1 -- 172.21.15.5:0/1517839318 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740d18a0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.339+0000 7fa079e86640 1 --2- 172.21.15.5:0/1517839318 >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 0x7fa0740cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:56:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa079685640 1 --2- 172.21.15.5:0/1517839318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740cfdb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa064009870 tx=0x7fa06401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd654e32164f4190 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa078e84640 1 -- 172.21.15.5:0/1517839318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640a89f0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa078e84640 1 -- 172.21.15.5:0/1517839318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0640a8b50 con 0x7fa0740cf1b0 2023-11-24T07:56:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa078e84640 1 -- 172.21.15.5:0/1517839318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640b0440 con 0x7fa0740cf1b0 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1517839318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 msgr2=0x7fa0740cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1517839318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740cfdb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa064009870 tx=0x7fa06401ecf0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1517839318 shutdown_connections 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1517839318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740cfdb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1517839318 >> v2:172.21.15.102:3300/0 conn(0x7fa07415d530 0x7fa0740cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1517839318 >> 172.21.15.5:0/1517839318 conn(0x7fa07409c6d0 msgr2=0x7fa0740d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1517839318 shutdown_connections 2023-11-24T07:56:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.343+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1517839318 wait complete. 2023-11-24T07:56:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 Processor -- start 2023-11-24T07:56:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- start start 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0740d02f0 0x7fa074156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa07415d530 0x7fa0741585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0741575e0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074158160 con 0x7fa0740d02f0 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa074157830 con 0x7fa07415d530 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57474/0 (socket says 172.21.15.5:57474) 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 -- 172.21.15.5:0/1397718794 learned_addr learned my addr 172.21.15.5:0/1397718794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079685640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0740d02f0 0x7fa074156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07a687640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa07415d530 0x7fa0741585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 -- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa07415d530 msgr2=0x7fa0741585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa07415d530 0x7fa0741585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 -- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0740d02f0 msgr2=0x7fa074156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0740d02f0 0x7fa074156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 -- 172.21.15.5:0/1397718794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640094d0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa079e86640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa07000e810 tx=0x7fa07000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000c8d0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07000ca30 con 0x7fa0740cf1b0 2023-11-24T07:56:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074157b10 con 0x7fa0740cf1b0 2023-11-24T07:56:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000cdc0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.347+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa074156e60 con 0x7fa0740cf1b0 2023-11-24T07:56:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07404e850 con 0x7fa0740cf1b0 2023-11-24T07:56:59.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa070013410 con 0x7fa0740cf1b0 2023-11-24T07:56:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa06a7fc640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 0x7fa058068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa070083bb0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa079685640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 0x7fa058068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.351+0000 7fa079685640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 0x7fa058068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa0640b2000 tx=0x7fa064009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.355+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0700510d0 con 0x7fa0740cf1b0 2023-11-24T07:56:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa0740cf980 con 0x7fa0740cf1b0 2023-11-24T07:56:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa06a7fc640 1 -- 172.21.15.5:0/1397718794 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa070009480 con 0x7fa0740cf1b0 2023-11-24T07:56:59.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:59.550 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T07:56:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 msgr2=0x7fa058068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 0x7fa058068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa0640b2000 tx=0x7fa064009040 comp rx=0 tx=0).stop 2023-11-24T07:56:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 msgr2=0x7fa0740b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa07000e810 tx=0x7fa07000ecd0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 shutdown_connections 2023-11-24T07:56:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa0580664a0 0x7fa058068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa07415d530 0x7fa0741585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0740d02f0 0x7fa074156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 --2- 172.21.15.5:0/1397718794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0740cf1b0 0x7fa0740b8cc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 >> 172.21.15.5:0/1397718794 conn(0x7fa07409c6d0 msgr2=0x7fa0740b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:59.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 shutdown_connections 2023-11-24T07:56:59.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.547+0000 7fa07c0ea640 1 -- 172.21.15.5:0/1397718794 wait complete. 2023-11-24T07:56:59.570 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T07:56:59.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:56:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 Processor -- start 2023-11-24T07:56:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 -- start start 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 0x7f96840d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 0x7f96840d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96840d1eb0 0x7f96840cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840d2340 con 0x7f96840d1eb0 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840cefd0 con 0x7f968415d7b0 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968c232640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cf2b0 con 0x7f96840cead0 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96840d1eb0 0x7f96840cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96840d1eb0 0x7f96840cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57478/0 (socket says 172.21.15.5:57478) 2023-11-24T07:56:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 -- 172.21.15.5:0/1055503158 learned_addr learned my addr 172.21.15.5:0/1055503158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f9689fce640 1 --2- 172.21.15.5:0/1055503158 >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 0x7f96840d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f96897cd640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 0x7f96840d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 -- 172.21.15.5:0/1055503158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 msgr2=0x7f96840d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 0x7f96840d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 -- 172.21.15.5:0/1055503158 >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 msgr2=0x7f96840d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:56:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 --2- 172.21.15.5:0/1055503158 >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 0x7f96840d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f968a7cf640 1 -- 172.21.15.5:0/1055503158 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968406b3f0 con 0x7f96840d1eb0 2023-11-24T07:56:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f9689fce640 1 --2- 172.21.15.5:0/1055503158 >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 0x7f96840d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.711+0000 7f96897cd640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 0x7f96840d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:56:59.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968a7cf640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840d1eb0 0x7f96840cfc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f96840d3310 tx=0x7f967c01c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5acd71696345b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f9688fcc640 1 -- 172.21.15.5:0/1055503158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0a6450 con 0x7f96840d1eb0 2023-11-24T07:56:59.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f9688fcc640 1 -- 172.21.15.5:0/1055503158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c0a65b0 con 0x7f96840d1eb0 2023-11-24T07:56:59.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f9688fcc640 1 -- 172.21.15.5:0/1055503158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0a6940 con 0x7f96840d1eb0 2023-11-24T07:56:59.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 -- 172.21.15.5:0/1055503158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840d1eb0 msgr2=0x7f96840cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840d1eb0 0x7f96840cfc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f96840d3310 tx=0x7f967c01c5c0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 -- 172.21.15.5:0/1055503158 shutdown_connections 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840d1eb0 0x7f96840cfc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 --2- 172.21.15.5:0/1055503158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96840cead0 0x7f96840d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 --2- 172.21.15.5:0/1055503158 >> v2:172.21.15.102:3300/0 conn(0x7f968415d7b0 0x7f96840d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 -- 172.21.15.5:0/1055503158 >> 172.21.15.5:0/1055503158 conn(0x7f96840d33b0 msgr2=0x7f96840d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 -- 172.21.15.5:0/1055503158 shutdown_connections 2023-11-24T07:56:59.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.715+0000 7f968c232640 1 -- 172.21.15.5:0/1055503158 wait complete. 2023-11-24T07:56:59.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 Processor -- start 2023-11-24T07:56:59.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- start start 2023-11-24T07:56:59.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96840d1eb0 0x7f96840cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f968415d7b0 0x7f96840cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cbfb0 con 0x7f96840cead0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9684155610 con 0x7f96840d1eb0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cb930 con 0x7f968415d7b0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57486/0 (socket says 172.21.15.5:57486) 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 -- 172.21.15.5:0/2100275880 learned_addr learned my addr 172.21.15.5:0/2100275880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f96897cd640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96840d1eb0 0x7f96840cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968a7cf640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f968415d7b0 0x7f96840cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 -- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f968415d7b0 msgr2=0x7f96840cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f968415d7b0 0x7f96840cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 -- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96840d1eb0 msgr2=0x7f96840cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96840d1eb0 0x7f96840cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 -- 172.21.15.5:0/2100275880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009b30 con 0x7f96840cead0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f9689fce640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f968000c820 tx=0x7f968000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680007a30 con 0x7f96840cead0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680007b90 con 0x7f96840cead0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000ce10 con 0x7f96840cead0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684157d80 con 0x7f96840cead0 2023-11-24T07:56:59.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96840cbbd0 con 0x7f96840cead0 2023-11-24T07:56:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.719+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840cc0f0 con 0x7f96840cead0 2023-11-24T07:56:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.723+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96800113f0 con 0x7f96840cead0 2023-11-24T07:56:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.723+0000 7f967a7fc640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 0x7f9668068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:56:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.723+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9680083e20 con 0x7f96840cead0 2023-11-24T07:56:59.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.723+0000 7f96897cd640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 0x7f9668068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:56:59.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.723+0000 7f96897cd640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 0x7f9668068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9684156c30 tx=0x7f9674008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:56:59.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.727+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96840cc0f0 con 0x7f96840cead0 2023-11-24T07:56:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.883+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96840cc0f0 con 0x7f96840cead0 2023-11-24T07:56:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f967a7fc640 1 -- 172.21.15.5:0/2100275880 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f96840cc0f0 con 0x7f96840cead0 2023-11-24T07:56:59.889 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:56:59.889 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:56:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 msgr2=0x7f9668068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 0x7f9668068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9684156c30 tx=0x7f9674008040 comp rx=0 tx=0).stop 2023-11-24T07:56:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 msgr2=0x7f96840b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:56:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f968000c820 tx=0x7f968000cce0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 shutdown_connections 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9668066470 0x7f9668068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f968415d7b0 0x7f96840cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96840d1eb0 0x7f96840cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 --2- 172.21.15.5:0/2100275880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96840cead0 0x7f96840b6d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 >> 172.21.15.5:0/2100275880 conn(0x7f96840d33b0 msgr2=0x7f96840cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 shutdown_connections 2023-11-24T07:56:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:56:59.887+0000 7f968c232640 1 -- 172.21.15.5:0/2100275880 wait complete. 2023-11-24T07:56:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:56:59.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:00.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 Processor -- start 2023-11-24T07:57:00.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 -- start start 2023-11-24T07:57:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 0x7ff3a00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00cdfb0 con 0x7ff3a00ced30 2023-11-24T07:57:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00d4140 con 0x7ff3a015d8f0 2023-11-24T07:57:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a812a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00d4420 con 0x7ff3a00d0510 2023-11-24T07:57:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a56c5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3a00ced30 0x7ff3a00cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46036/0 (socket says 172.21.15.5:46036) 2023-11-24T07:57:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a56c5640 1 -- 172.21.15.5:0/2386289609 learned_addr learned my addr 172.21.15.5:0/2386289609 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a66c7640 1 --2- 172.21.15.5:0/2386289609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 0x7ff3a00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508701987 0 0) 0x7ff3a00cdfb0 con 0x7ff3a00ced30 2023-11-24T07:57:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38c003530 con 0x7ff3a00ced30 2023-11-24T07:57:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792098926 0 0) 0x7ff3a00d4140 con 0x7ff3a015d8f0 2023-11-24T07:57:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a00cdfb0 con 0x7ff3a015d8f0 2023-11-24T07:57:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a66c7640 1 -- 172.21.15.5:0/2386289609 >> v1:172.21.15.102:6789/0 conn(0x7ff3a015d8f0 legacy=0x7ff3a015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a66c7640 1 -- 172.21.15.5:0/2386289609 >> v1:172.21.15.5:6789/0 conn(0x7ff3a00ced30 legacy=0x7ff3a00cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.055+0000 7ff3a66c7640 1 -- 172.21.15.5:0/2386289609 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00ce250 con 0x7ff3a00d0510 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a66c7640 1 --2- 172.21.15.5:0/2386289609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 0x7ff3a00d1000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff398009dc0 tx=0x7ff39801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18de3e3eea18965f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980a5910 con 0x7ff3a00d0510 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3980a5a70 con 0x7ff3a00d0510 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a4ec4640 1 -- 172.21.15.5:0/2386289609 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980a5e00 con 0x7ff3a00d0510 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 -- 172.21.15.5:0/2386289609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 msgr2=0x7ff3a00d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2386289609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 0x7ff3a00d1000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff398009dc0 tx=0x7ff39801c940 comp rx=0 tx=0).stop 2023-11-24T07:57:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 -- 172.21.15.5:0/2386289609 shutdown_connections 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2386289609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00d0510 0x7ff3a00d1000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 -- 172.21.15.5:0/2386289609 >> 172.21.15.5:0/2386289609 conn(0x7ff3a009c750 msgr2=0x7ff3a00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 -- 172.21.15.5:0/2386289609 shutdown_connections 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.059+0000 7ff3a812a640 1 -- 172.21.15.5:0/2386289609 wait complete. 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 Processor -- start 2023-11-24T07:57:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 -- start start 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 0x7ff3a01f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3a015d8f0 0x7ff3a01f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01f7f20 con 0x7ff3a00d0510 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00cabb0 con 0x7ff3a015d8f0 2023-11-24T07:57:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a812a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0160eb0 con 0x7ff3a00ced30 2023-11-24T07:57:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a56c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 0x7ff3a01f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a66c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3a015d8f0 0x7ff3a01f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:45798/0 (socket says 172.21.15.5:45798) 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 -- 172.21.15.5:0/2894580795 learned_addr learned my addr 172.21.15.5:0/2894580795 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 -- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3a015d8f0 msgr2=0x7ff3a01f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3a015d8f0 0x7ff3a01f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 -- 172.21.15.5:0/2894580795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 msgr2=0x7ff3a01f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 0x7ff3a01f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 -- 172.21.15.5:0/2894580795 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009a70 con 0x7ff3a00ced30 2023-11-24T07:57:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a56c5640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 0x7ff3a01f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.063+0000 7ff3a5ec6640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c430 tx=0x7ff39c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0052d0 con 0x7ff3a00ced30 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c005450 con 0x7ff3a00ced30 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c003840 con 0x7ff3a00ced30 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0161190 con 0x7ff3a00ced30 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a0161750 con 0x7ff3a00ced30 2023-11-24T07:57:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a004e850 con 0x7ff3a00ced30 2023-11-24T07:57:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff39c0039a0 con 0x7ff3a00ced30 2023-11-24T07:57:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 0x7ff384068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff39c0833f0 con 0x7ff3a00ced30 2023-11-24T07:57:00.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3a56c5640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 0x7ff384068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.067+0000 7ff3a56c5640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 0x7ff384068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00c9d90 tx=0x7ff390007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.071+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff39c050910 con 0x7ff3a00ced30 2023-11-24T07:57:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.231+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3a00cf9d0 con 0x7ff3a00ced30 2023-11-24T07:57:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.231+0000 7ff3967fc640 1 -- 172.21.15.5:0/2894580795 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff39c053f30 con 0x7ff3a00ced30 2023-11-24T07:57:00.235 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 msgr2=0x7ff384068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 0x7ff384068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00c9d90 tx=0x7ff390007d60 comp rx=0 tx=0).stop 2023-11-24T07:57:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 msgr2=0x7ff3a015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c430 tx=0x7ff39c00c8f0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 shutdown_connections 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff3840664a0 0x7ff384068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3a015d8f0 0x7ff3a01f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3a00d0510 0x7ff3a01f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 --2- 172.21.15.5:0/2894580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3a00ced30 0x7ff3a015a2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 >> 172.21.15.5:0/2894580795 conn(0x7ff3a009c750 msgr2=0x7ff3a00b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 shutdown_connections 2023-11-24T07:57:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.235+0000 7ff3a812a640 1 -- 172.21.15.5:0/2894580795 wait complete. 2023-11-24T07:57:00.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:00.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 Processor -- start 2023-11-24T07:57:00.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 -- start start 2023-11-24T07:57:00.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49040ced30 0x7f49040cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040cdfb0 con 0x7f49040cf1e0 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040d4140 con 0x7f490415d8f0 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f490a72a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040d4420 con 0x7f49040ced30 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4908cc7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49040cf1e0 0x7f49040d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46042/0 (socket says 172.21.15.5:46042) 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4908cc7640 1 -- 172.21.15.5:0/757325196 learned_addr learned my addr 172.21.15.5:0/757325196 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> v2:172.21.15.102:3300/0 conn(0x7f49040ced30 0x7f49040cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639790843 0 0) 0x7f49040cdfb0 con 0x7f49040cf1e0 2023-11-24T07:57:00.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ec003530 con 0x7f49040cf1e0 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334862614 0 0) 0x7f49040d4140 con 0x7f490415d8f0 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49040cdfb0 con 0x7f490415d8f0 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 581752242 0 0) 0x7f48ec003530 con 0x7f49040cf1e0 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 >> v2:172.21.15.102:3300/0 conn(0x7f49040ced30 msgr2=0x7f49040cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 --2- 172.21.15.5:0/757325196 >> v2:172.21.15.102:3300/0 conn(0x7f49040ced30 0x7f49040cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 >> v1:172.21.15.102:6789/0 conn(0x7f490415d8f0 legacy=0x7f490415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040ce250 con 0x7f49040cf1e0 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f48fc001a00 con 0x7f49040cf1e0 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.399+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 >> v1:172.21.15.5:6789/0 conn(0x7f49040cf1e0 legacy=0x7f49040d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec003b60 0x7f48ec003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 0x7f48ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48ec005190 0x7f48ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040d4420 con 0x7f48ec0047d0 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec00c060 con 0x7f48ec005190 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec00c220 con 0x7f48ec003b60 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> v2:172.21.15.102:3300/0 conn(0x7f49040ced30 0x7f49040cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4903fff640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec003b60 0x7f48ec003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 0x7f48ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4908cc7640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48ec005190 0x7f48ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 -- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec003b60 msgr2=0x7f48ec003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec003b60 0x7f48ec003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 -- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48ec005190 msgr2=0x7f48ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48ec005190 0x7f48ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 -- 172.21.15.5:0/757325196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec003530 con 0x7f48ec0047d0 2023-11-24T07:57:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4908cc7640 1 -- 172.21.15.5:0/757325196 reap_dead start 2023-11-24T07:57:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f49037fe640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 0x7f48ec004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009c90 tx=0x7f48f801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225f4fb735585674 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8004020 con 0x7f48ec0047d0 2023-11-24T07:57:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f8004180 con 0x7f48ec0047d0 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.403+0000 7f4902ffd640 1 -- 172.21.15.5:0/757325196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80a5890 con 0x7f48ec0047d0 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 msgr2=0x7f48ec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 0x7f48ec004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009c90 tx=0x7f48f801cbd0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- 172.21.15.5:0/757325196 shutdown_connections 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 --2- 172.21.15.5:0/757325196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48ec0047d0 0x7f48ec004c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- 172.21.15.5:0/757325196 >> 172.21.15.5:0/757325196 conn(0x7f490409c750 msgr2=0x7f49040d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- 172.21.15.5:0/757325196 shutdown_connections 2023-11-24T07:57:00.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- 172.21.15.5:0/757325196 wait complete. 2023-11-24T07:57:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 Processor -- start 2023-11-24T07:57:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- start start 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 0x7f49040cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 0x7f4904156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040b7470 con 0x7f49040b6010 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041567b0 con 0x7f49040b7890 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f490a72a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040b67f0 con 0x7f48ec0047d0 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f4908cc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f4908cc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57512/0 (socket says 172.21.15.5:57512) 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f4908cc7640 1 -- 172.21.15.5:0/1948041475 learned_addr learned my addr 172.21.15.5:0/1948041475 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f4903fff640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 0x7f49040cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.407+0000 7f49037fe640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 0x7f4904156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 -- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 msgr2=0x7f49040cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 0x7f49040cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 -- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 msgr2=0x7f4904156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 0x7f4904156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 -- 172.21.15.5:0/1948041475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040b6ad0 con 0x7f49040b6010 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f49037fe640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 0x7f4904156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4903fff640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 0x7f49040cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4908cc7640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48fc002240 tx=0x7f48fc00a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00ab80 con 0x7f49040b6010 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00ad00 con 0x7f49040b6010 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc013630 con 0x7f49040b6010 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040b6db0 con 0x7f49040b6010 2023-11-24T07:57:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040b6490 con 0x7f49040b6010 2023-11-24T07:57:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49040b75b0 con 0x7f49040b6010 2023-11-24T07:57:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48fc013790 con 0x7f49040b6010 2023-11-24T07:57:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.411+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48fc084810 con 0x7f49040b6010 2023-11-24T07:57:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.415+0000 7f4903fff640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.415+0000 7f4903fff640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 0x7f48f0068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005630 tx=0x7f48f4007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.415+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49040b75b0 con 0x7f49040b6010 2023-11-24T07:57:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.571+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49040b75b0 con 0x7f49040b6010 2023-11-24T07:57:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f4900ff9640 1 -- 172.21.15.5:0/1948041475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49040b75b0 con 0x7f49040b6010 2023-11-24T07:57:00.577 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 msgr2=0x7f48f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 0x7f48f0068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005630 tx=0x7f48f4007cb0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 msgr2=0x7f49040cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48fc002240 tx=0x7f48fc00a600 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 shutdown_connections 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49040b6010 0x7f49040cbd50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49040b7890 0x7f4904156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 --2- 172.21.15.5:0/1948041475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48ec0047d0 0x7f49040cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 >> 172.21.15.5:0/1948041475 conn(0x7f490409c750 msgr2=0x7f49040b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 shutdown_connections 2023-11-24T07:57:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.575+0000 7f490a72a640 1 -- 172.21.15.5:0/1948041475 wait complete. 2023-11-24T07:57:00.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:00.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 Processor -- start 2023-11-24T07:57:00.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 -- start start 2023-11-24T07:57:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a400cb9b0 0x7f5a4006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a400cbd90 0x7f5a4015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a4015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4015bba0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cdd50 con 0x7f5a400cbd90 2023-11-24T07:57:00.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a48380640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40159630 con 0x7f5a400ce5d0 2023-11-24T07:57:00.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a4611c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a400cb9b0 0x7f5a4006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a4611c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a400cb9b0 0x7f5a4006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57528/0 (socket says 172.21.15.5:57528) 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a4591b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a400cbd90 0x7f5a4015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a4611c640 1 -- 172.21.15.5:0/1219124442 learned_addr learned my addr 172.21.15.5:0/1219124442 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.739+0000 7f5a4691d640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a4015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 -- 172.21.15.5:0/1219124442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 msgr2=0x7f5a4015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a4015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 -- 172.21.15.5:0/1219124442 >> v2:172.21.15.102:3300/0 conn(0x7f5a400cbd90 msgr2=0x7f5a4015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:00.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 --2- 172.21.15.5:0/1219124442 >> v2:172.21.15.102:3300/0 conn(0x7f5a400cbd90 0x7f5a4015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 -- 172.21.15.5:0/1219124442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4015f6d0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4611c640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4006e3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b5200 tx=0x7f5a3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759efef45c6e9112 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4511a640 1 -- 172.21.15.5:0/1219124442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0ab670 con 0x7f5a400cb9b0 2023-11-24T07:57:00.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4511a640 1 -- 172.21.15.5:0/1219124442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0ab7d0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a4511a640 1 -- 172.21.15.5:0/1219124442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0abb60 con 0x7f5a400cb9b0 2023-11-24T07:57:00.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a48380640 1 -- 172.21.15.5:0/1219124442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 msgr2=0x7f5a4006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.743+0000 7f5a48380640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4006e3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b5200 tx=0x7f5a3c01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- 172.21.15.5:0/1219124442 shutdown_connections 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a4015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- 172.21.15.5:0/1219124442 >> v2:172.21.15.102:3300/0 conn(0x7f5a400cbd90 0x7f5a4015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- 172.21.15.5:0/1219124442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4006e3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- 172.21.15.5:0/1219124442 >> 172.21.15.5:0/1219124442 conn(0x7f5a400b0cb0 msgr2=0x7f5a400b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- 172.21.15.5:0/1219124442 shutdown_connections 2023-11-24T07:57:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- 172.21.15.5:0/1219124442 wait complete. 2023-11-24T07:57:00.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 Processor -- start 2023-11-24T07:57:00.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- start start 2023-11-24T07:57:00.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a400cbd90 0x7f5a40158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a40071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40099a30 con 0x7f5a400cb9b0 2023-11-24T07:57:00.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4009a850 con 0x7f5a400cbd90 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a48380640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4009d0b0 con 0x7f5a400ce5d0 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57540/0 (socket says 172.21.15.5:57540) 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 -- 172.21.15.5:0/2503005399 learned_addr learned my addr 172.21.15.5:0/2503005399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4591b640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a400cbd90 0x7f5a40158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4691d640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a40071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 -- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 msgr2=0x7f5a40071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a40071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 -- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a400cbd90 msgr2=0x7f5a40158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a400cbd90 0x7f5a40158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 -- 172.21.15.5:0/2503005399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0094d0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4691d640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a40071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.747+0000 7f5a4611c640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c01ab80 tx=0x7f5a3c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0be5f0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0be750 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0beae0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a40099c40 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4009a200 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400671f0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a3c0b43f0 con 0x7f5a400cb9b0 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:00.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a3c11eb30 con 0x7f5a400cb9b0 2023-11-24T07:57:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.751+0000 7f5a4591b640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.755+0000 7f5a4591b640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a4015d800 tx=0x7f5a30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:00.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.755+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a3c0ec070 con 0x7f5a400cb9b0 2023-11-24T07:57:00.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.915+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a4006b460 con 0x7f5a400cb9b0 2023-11-24T07:57:00.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.915+0000 7f5a36ffd640 1 -- 172.21.15.5:0/2503005399 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a3c0ef690 con 0x7f5a400cb9b0 2023-11-24T07:57:00.920 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 msgr2=0x7f5a24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a4015d800 tx=0x7f5a30009190 comp rx=0 tx=0).stop 2023-11-24T07:57:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 msgr2=0x7f5a4009cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c01ab80 tx=0x7f5a3c01ad10 comp rx=0 tx=0).stop 2023-11-24T07:57:00.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 shutdown_connections 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a400ce5d0 0x7f5a40071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a400cbd90 0x7f5a40158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 --2- 172.21.15.5:0/2503005399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a400cb9b0 0x7f5a4009cb70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 >> 172.21.15.5:0/2503005399 conn(0x7f5a400b0cb0 msgr2=0x7f5a400b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 shutdown_connections 2023-11-24T07:57:00.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:00.919+0000 7f5a48380640 1 -- 172.21.15.5:0/2503005399 wait complete. 2023-11-24T07:57:00.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.079+0000 7f9fb07a1640 1 Processor -- start 2023-11-24T07:57:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.079+0000 7f9fb07a1640 1 -- start start 2023-11-24T07:57:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fb07a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fa80ce5c0 0x7f9fa80cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fb07a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa806a5b0 0x7f9fa806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fb07a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80b0a70 con 0x7f9fa815d8b0 2023-11-24T07:57:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fb07a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80cddb0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fb07a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80b4100 con 0x7f9fa80ce5c0 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa806a5b0 0x7f9fa806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa806a5b0 0x7f9fa806aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57552/0 (socket says 172.21.15.5:57552) 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 -- 172.21.15.5:0/3386663268 learned_addr learned my addr 172.21.15.5:0/3386663268 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9fadd3c640 1 --2- 172.21.15.5:0/3386663268 >> v2:172.21.15.102:3300/0 conn(0x7f9fa80ce5c0 0x7f9fa80cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 -- 172.21.15.5:0/3386663268 >> v2:172.21.15.102:3300/0 conn(0x7f9fa80ce5c0 msgr2=0x7f9fa80cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 --2- 172.21.15.5:0/3386663268 >> v2:172.21.15.102:3300/0 conn(0x7f9fa80ce5c0 0x7f9fa80cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 -- 172.21.15.5:0/3386663268 >> v1:172.21.15.102:6789/0 conn(0x7f9fa815d8b0 legacy=0x7f9fa80b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 -- 172.21.15.5:0/3386663268 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80b43e0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.083+0000 7f9faed3e640 1 --2- 172.21.15.5:0/3386663268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa806aa20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b1780 tx=0x7f9fa001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c106cb3245fb53d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fad53b640 1 -- 172.21.15.5:0/3386663268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00af400 con 0x7f9fa806a5b0 2023-11-24T07:57:01.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fad53b640 1 -- 172.21.15.5:0/3386663268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa00ab050 con 0x7f9fa806a5b0 2023-11-24T07:57:01.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fad53b640 1 -- 172.21.15.5:0/3386663268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00af780 con 0x7f9fa806a5b0 2023-11-24T07:57:01.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- 172.21.15.5:0/3386663268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 msgr2=0x7f9fa806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/3386663268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa806aa20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b1780 tx=0x7f9fa001f1c0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- 172.21.15.5:0/3386663268 shutdown_connections 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/3386663268 >> v2:172.21.15.102:3300/0 conn(0x7f9fa80ce5c0 0x7f9fa80cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/3386663268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa806aa20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- 172.21.15.5:0/3386663268 >> 172.21.15.5:0/3386663268 conn(0x7f9fa80b5570 msgr2=0x7f9fa80b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- 172.21.15.5:0/3386663268 shutdown_connections 2023-11-24T07:57:01.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- 172.21.15.5:0/3386663268 wait complete. 2023-11-24T07:57:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 Processor -- start 2023-11-24T07:57:01.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- start start 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fa80ce5c0 0x7f9fa81603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa815d8b0 0x7f9fa80ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815ffd0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815e9c0 con 0x7f9fa815d8b0 2023-11-24T07:57:01.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fb07a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815f910 con 0x7f9fa80ce5c0 2023-11-24T07:57:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fae53d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fae53d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57562/0 (socket says 172.21.15.5:57562) 2023-11-24T07:57:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fae53d640 1 -- 172.21.15.5:0/2683478892 learned_addr learned my addr 172.21.15.5:0/2683478892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9faed3e640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa815d8b0 0x7f9fa80ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.087+0000 7f9fadd3c640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fa80ce5c0 0x7f9fa81603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 -- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fa80ce5c0 msgr2=0x7f9fa81603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fa80ce5c0 0x7f9fa81603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 -- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa815d8b0 msgr2=0x7f9fa80ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa815d8b0 0x7f9fa80ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 -- 172.21.15.5:0/2683478892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0009b30 con 0x7f9fa806a5b0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fae53d640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c3c0 tx=0x7f9fa400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40052d0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4005430 con 0x7f9fa806a5b0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4003840 con 0x7f9fa806a5b0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa815fbf0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80cb1f0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa80b0540 con 0x7f9fa806a5b0 2023-11-24T07:57:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fa40039a0 con 0x7f9fa806a5b0 2023-11-24T07:57:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 0x7f9f8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa4083330 con 0x7f9fa806a5b0 2023-11-24T07:57:01.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.091+0000 7f9fadd3c640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 0x7f9f8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.095+0000 7f9fadd3c640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 0x7f9f8c068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fa81f6590 tx=0x7f9f98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.095+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fa4050850 con 0x7f9fa806a5b0 2023-11-24T07:57:01.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.287+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fa815f770 con 0x7f9fa806a5b0 2023-11-24T07:57:01.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.287+0000 7f9f9effd640 1 -- 172.21.15.5:0/2683478892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f9fa815f770 con 0x7f9fa806a5b0 2023-11-24T07:57:01.291 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:01.292 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 msgr2=0x7f9f8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 0x7f9f8c068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fa81f6590 tx=0x7f9f98009190 comp rx=0 tx=0).stop 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 msgr2=0x7f9fa80caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c3c0 tx=0x7f9fa400c880 comp rx=0 tx=0).stop 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 shutdown_connections 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f8c066470 0x7f9f8c068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fa815d8b0 0x7f9fa80ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fa80ce5c0 0x7f9fa81603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 --2- 172.21.15.5:0/2683478892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa806a5b0 0x7f9fa80caae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 >> 172.21.15.5:0/2683478892 conn(0x7f9fa80b5570 msgr2=0x7f9fa806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 shutdown_connections 2023-11-24T07:57:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.291+0000 7f9fb07a1640 1 -- 172.21.15.5:0/2683478892 wait complete. 2023-11-24T07:57:01.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.451+0000 7f6ba73a1640 1 Processor -- start 2023-11-24T07:57:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.451+0000 7f6ba73a1640 1 -- start start 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba73a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ba015f540 0x7f6ba00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba73a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba006cd40 0x7f6ba0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba73a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba00b2920 con 0x7f6ba00b1f40 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba73a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba00b2c00 con 0x7f6ba015f540 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba73a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00b2ee0 con 0x7f6ba006cd40 2023-11-24T07:57:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ba015f540 0x7f6ba00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ba015f540 0x7f6ba00b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57576/0 (socket says 172.21.15.5:57576) 2023-11-24T07:57:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 -- 172.21.15.5:0/2942310564 learned_addr learned my addr 172.21.15.5:0/2942310564 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba593e640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba006cd40 0x7f6ba0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 -- 172.21.15.5:0/2942310564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba006cd40 msgr2=0x7f6ba0070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba006cd40 0x7f6ba0070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 -- 172.21.15.5:0/2942310564 >> v1:172.21.15.102:6789/0 conn(0x7f6ba00b1f40 legacy=0x7f6ba006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.455+0000 7f6ba513d640 1 -- 172.21.15.5:0/2942310564 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00b31c0 con 0x7f6ba015f540 2023-11-24T07:57:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba513d640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba015f540 0x7f6ba00b39c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009870 tx=0x7f6b9c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa8abf5c4c15694 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6b97fff640 1 -- 172.21.15.5:0/2942310564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0a95f0 con 0x7f6ba015f540 2023-11-24T07:57:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6b97fff640 1 -- 172.21.15.5:0/2942310564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0a9750 con 0x7f6ba015f540 2023-11-24T07:57:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6b97fff640 1 -- 172.21.15.5:0/2942310564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0a9ae0 con 0x7f6ba015f540 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- 172.21.15.5:0/2942310564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba015f540 msgr2=0x7f6ba00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba015f540 0x7f6ba00b39c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009870 tx=0x7f6b9c01c510 comp rx=0 tx=0).stop 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- 172.21.15.5:0/2942310564 shutdown_connections 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba006cd40 0x7f6ba0070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/2942310564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba015f540 0x7f6ba00b39c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- 172.21.15.5:0/2942310564 >> 172.21.15.5:0/2942310564 conn(0x7f6ba00b0c40 msgr2=0x7f6ba00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- 172.21.15.5:0/2942310564 shutdown_connections 2023-11-24T07:57:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- 172.21.15.5:0/2942310564 wait complete. 2023-11-24T07:57:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 Processor -- start 2023-11-24T07:57:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- start start 2023-11-24T07:57:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ba006cd40 0x7f6ba01421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba015f540 0x7f6ba015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0142720 con 0x7f6ba00b1f40 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0158550 con 0x7f6ba006cd40 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.459+0000 7f6ba73a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00ad0a0 con 0x7f6ba015f540 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57590/0 (socket says 172.21.15.5:57590) 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 -- 172.21.15.5:0/3000918115 learned_addr learned my addr 172.21.15.5:0/3000918115 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba593e640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba015f540 0x7f6ba015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba513d640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ba006cd40 0x7f6ba01421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 -- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba015f540 msgr2=0x7f6ba015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba015f540 0x7f6ba015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 -- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ba006cd40 msgr2=0x7f6ba01421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ba006cd40 0x7f6ba01421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 -- 172.21.15.5:0/3000918115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0094d0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba493c640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c480 tx=0x7f6b9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900052d0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90005450 con 0x7f6ba00b1f40 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba0151920 con 0x7f6ba00b1f40 2023-11-24T07:57:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90012870 con 0x7f6ba00b1f40 2023-11-24T07:57:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba00ac770 con 0x7f6ba00b1f40 2023-11-24T07:57:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba004e850 con 0x7f6ba00b1f40 2023-11-24T07:57:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b900129d0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.463+0000 7f6b95ffb640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.467+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b90083a50 con 0x7f6ba00b1f40 2023-11-24T07:57:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.467+0000 7f6ba513d640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.467+0000 7f6ba513d640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 0x7f6b84068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ae000 tx=0x7f6b9c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.467+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b90050ec0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.627+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba00ad1e0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.627+0000 7f6b95ffb640 1 -- 172.21.15.5:0/3000918115 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f6b900544e0 con 0x7f6ba00b1f40 2023-11-24T07:57:01.631 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:01.632 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 msgr2=0x7f6b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 0x7f6b84068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ae000 tx=0x7f6b9c0b3040 comp rx=0 tx=0).stop 2023-11-24T07:57:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 msgr2=0x7f6ba0158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c480 tx=0x7f6b9000c940 comp rx=0 tx=0).stop 2023-11-24T07:57:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 shutdown_connections 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ba015f540 0x7f6ba015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ba00b1f40 0x7f6ba0158010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 --2- 172.21.15.5:0/3000918115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ba006cd40 0x7f6ba01421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 >> 172.21.15.5:0/3000918115 conn(0x7f6ba00b0c40 msgr2=0x7f6ba006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 shutdown_connections 2023-11-24T07:57:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.631+0000 7f6ba73a1640 1 -- 172.21.15.5:0/3000918115 wait complete. 2023-11-24T07:57:01.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:01.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.795+0000 7f86cf49c640 1 Processor -- start 2023-11-24T07:57:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 -- start start 2023-11-24T07:57:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 0x7f86c806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c80ce5d0 0x7f86c815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c8159630 con 0x7f86c80cbd90 2023-11-24T07:57:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c815bba0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cf49c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80cdd50 con 0x7f86c80cb9b0 2023-11-24T07:57:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c80ce5d0 0x7f86c815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c80ce5d0 0x7f86c815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57594/0 (socket says 172.21.15.5:57594) 2023-11-24T07:57:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 -- 172.21.15.5:0/3632656091 learned_addr learned my addr 172.21.15.5:0/3632656091 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cd238640 1 --2- 172.21.15.5:0/3632656091 >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 0x7f86c806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 -- 172.21.15.5:0/3632656091 >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 msgr2=0x7f86c806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 --2- 172.21.15.5:0/3632656091 >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 0x7f86c806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 -- 172.21.15.5:0/3632656091 >> v1:172.21.15.102:6789/0 conn(0x7f86c80cbd90 legacy=0x7f86c815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cda39640 1 -- 172.21.15.5:0/3632656091 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80cd1d0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.799+0000 7f86cd238640 1 --2- 172.21.15.5:0/3632656091 >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 0x7f86c806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cda39640 1 --2- 172.21.15.5:0/3632656091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c815bfd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86c806c360 tx=0x7f86c001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd75faa92363079f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86bffff640 1 -- 172.21.15.5:0/3632656091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00a5800 con 0x7f86c80ce5d0 2023-11-24T07:57:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86bffff640 1 -- 172.21.15.5:0/3632656091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00a5960 con 0x7f86c80ce5d0 2023-11-24T07:57:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86bffff640 1 -- 172.21.15.5:0/3632656091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00a5cf0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- 172.21.15.5:0/3632656091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 msgr2=0x7f86c815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3632656091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c815bfd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86c806c360 tx=0x7f86c001c960 comp rx=0 tx=0).stop 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- 172.21.15.5:0/3632656091 shutdown_connections 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3632656091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c815bfd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3632656091 >> v2:172.21.15.102:3300/0 conn(0x7f86c80cb9b0 0x7f86c806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- 172.21.15.5:0/3632656091 >> 172.21.15.5:0/3632656091 conn(0x7f86c80b0cb0 msgr2=0x7f86c80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- 172.21.15.5:0/3632656091 shutdown_connections 2023-11-24T07:57:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- 172.21.15.5:0/3632656091 wait complete. 2023-11-24T07:57:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 Processor -- start 2023-11-24T07:57:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.803+0000 7f86cf49c640 1 -- start start 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80cb9b0 0x7f86c809c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 0x7f86c81586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80b3330 con 0x7f86c80ce5d0 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80b3610 con 0x7f86c80cbd90 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80b38f0 con 0x7f86c80cb9b0 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57600/0 (socket says 172.21.15.5:57600) 2023-11-24T07:57:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 -- 172.21.15.5:0/3810855104 learned_addr learned my addr 172.21.15.5:0/3810855104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cd238640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80cb9b0 0x7f86c809c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cca37640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 0x7f86c81586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 -- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80cb9b0 msgr2=0x7f86c809c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80cb9b0 0x7f86c809c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 -- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 msgr2=0x7f86c81586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 0x7f86c81586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 -- 172.21.15.5:0/3810855104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0009b30 con 0x7f86c80ce5d0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cca37640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 0x7f86c81586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cda39640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86c00af040 tx=0x7f86c0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b8670 con 0x7f86c80ce5d0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00b8810 con 0x7f86c80ce5d0 2023-11-24T07:57:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80b3bd0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b8bc0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c8158c10 con 0x7f86c80ce5d0 2023-11-24T07:57:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.807+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80671f0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.811+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86c00b8d20 con 0x7f86c80ce5d0 2023-11-24T07:57:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.811+0000 7f86bdffb640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 0x7f86ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.811+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86c011f590 con 0x7f86c80ce5d0 2023-11-24T07:57:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.811+0000 7f86cd238640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 0x7f86ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.811+0000 7f86cd238640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 0x7f86ac068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b23b0 tx=0x7f86c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.815+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86c00eca90 con 0x7f86c80ce5d0 2023-11-24T07:57:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86c80671f0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86bdffb640 1 -- 172.21.15.5:0/3810855104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86c00f00b0 con 0x7f86c80ce5d0 2023-11-24T07:57:01.974 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 msgr2=0x7f86ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 0x7f86ac068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b23b0 tx=0x7f86c4008040 comp rx=0 tx=0).stop 2023-11-24T07:57:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 msgr2=0x7f86c809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86c00af040 tx=0x7f86c0019700 comp rx=0 tx=0).stop 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 shutdown_connections 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f86ac066470 0x7f86ac068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c80ce5d0 0x7f86c809a8e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c80cbd90 0x7f86c81586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 --2- 172.21.15.5:0/3810855104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80cb9b0 0x7f86c809c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.971+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 >> 172.21.15.5:0/3810855104 conn(0x7f86c80b0cb0 msgr2=0x7f86c8071760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.975+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 shutdown_connections 2023-11-24T07:57:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:01.975+0000 7f86cf49c640 1 -- 172.21.15.5:0/3810855104 wait complete. 2023-11-24T07:57:01.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 Processor -- start 2023-11-24T07:57:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 -- start start 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9080cdfb0 0x7fe9080abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9080cbd50 0x7fe9080cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080b2710 con 0x7fe90815a710 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080cca80 con 0x7fe9080cbd50 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90e291640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080b29f0 con 0x7fe9080cdfb0 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9080cbd50 0x7fe9080cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9080cbd50 0x7fe9080cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57612/0 (socket says 172.21.15.5:57612) 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 -- 172.21.15.5:0/1028243665 learned_addr learned my addr 172.21.15.5:0/1028243665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe907fff640 1 --2- 172.21.15.5:0/1028243665 >> v2:172.21.15.102:3300/0 conn(0x7fe9080cdfb0 0x7fe9080abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 -- 172.21.15.5:0/1028243665 >> v2:172.21.15.102:3300/0 conn(0x7fe9080cdfb0 msgr2=0x7fe9080abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:02.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 --2- 172.21.15.5:0/1028243665 >> v2:172.21.15.102:3300/0 conn(0x7fe9080cdfb0 0x7fe9080abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 -- 172.21.15.5:0/1028243665 >> v1:172.21.15.102:6789/0 conn(0x7fe90815a710 legacy=0x7fe9080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.139+0000 7fe90c82e640 1 -- 172.21.15.5:0/1028243665 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080b2cd0 con 0x7fe9080cbd50 2023-11-24T07:57:02.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90c82e640 1 --2- 172.21.15.5:0/1028243665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cbd50 0x7fe9080cc1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe90806c270 tx=0x7fe90001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc09aaff4d4efa6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe906ffd640 1 -- 172.21.15.5:0/1028243665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a5880 con 0x7fe9080cbd50 2023-11-24T07:57:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe906ffd640 1 -- 172.21.15.5:0/1028243665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000a59e0 con 0x7fe9080cbd50 2023-11-24T07:57:02.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe906ffd640 1 -- 172.21.15.5:0/1028243665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a5d70 con 0x7fe9080cbd50 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 -- 172.21.15.5:0/1028243665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cbd50 msgr2=0x7fe9080cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 --2- 172.21.15.5:0/1028243665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cbd50 0x7fe9080cc1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe90806c270 tx=0x7fe90001c9a0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 -- 172.21.15.5:0/1028243665 shutdown_connections 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 --2- 172.21.15.5:0/1028243665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cbd50 0x7fe9080cc1e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 --2- 172.21.15.5:0/1028243665 >> v2:172.21.15.102:3300/0 conn(0x7fe9080cdfb0 0x7fe9080abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 -- 172.21.15.5:0/1028243665 >> 172.21.15.5:0/1028243665 conn(0x7fe9080b0cb0 msgr2=0x7fe9080b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 -- 172.21.15.5:0/1028243665 shutdown_connections 2023-11-24T07:57:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.143+0000 7fe90e291640 1 -- 172.21.15.5:0/1028243665 wait complete. 2023-11-24T07:57:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 Processor -- start 2023-11-24T07:57:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- start start 2023-11-24T07:57:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9080cbd50 0x7fe908154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90815a710 0x7fe908151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90815adf0 con 0x7fe9080cdfb0 2023-11-24T07:57:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908153240 con 0x7fe90815a710 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe908152630 con 0x7fe9080cbd50 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57624/0 (socket says 172.21.15.5:57624) 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 -- 172.21.15.5:0/544805603 learned_addr learned my addr 172.21.15.5:0/544805603 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe907fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9080cbd50 0x7fe908154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90c82e640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90815a710 0x7fe908151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 -- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9080cbd50 msgr2=0x7fe908154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9080cbd50 0x7fe908154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 -- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90815a710 msgr2=0x7fe908151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90815a710 0x7fe908151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 -- 172.21.15.5:0/544805603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009b30 con 0x7fe9080cdfb0 2023-11-24T07:57:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe9077fe640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c390 tx=0x7fe8fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc0052d0 con 0x7fe9080cdfb0 2023-11-24T07:57:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc005430 con 0x7fe9080cdfb0 2023-11-24T07:57:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908152910 con 0x7fe9080cdfb0 2023-11-24T07:57:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003820 con 0x7fe9080cdfb0 2023-11-24T07:57:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.147+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe908152ed0 con 0x7fe9080cdfb0 2023-11-24T07:57:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908153090 con 0x7fe9080cdfb0 2023-11-24T07:57:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8fc003980 con 0x7fe9080cdfb0 2023-11-24T07:57:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe904ff9640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8fc083370 con 0x7fe9080cdfb0 2023-11-24T07:57:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe907fff640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.151+0000 7fe907fff640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 0x7fe8f4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe90815a480 tx=0x7fe8f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.155+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8fc050800 con 0x7fe9080cdfb0 2023-11-24T07:57:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9080671f0 con 0x7fe9080cdfb0 2023-11-24T07:57:02.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe904ff9640 1 -- 172.21.15.5:0/544805603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8fc053e20 con 0x7fe9080cdfb0 2023-11-24T07:57:02.318 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:02.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 msgr2=0x7fe8f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 0x7fe8f4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe90815a480 tx=0x7fe8f8008040 comp rx=0 tx=0).stop 2023-11-24T07:57:02.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 msgr2=0x7fe908155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c390 tx=0x7fe8fc00c850 comp rx=0 tx=0).stop 2023-11-24T07:57:02.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 shutdown_connections 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90815a710 0x7fe908151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9080cdfb0 0x7fe908155150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 --2- 172.21.15.5:0/544805603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9080cbd50 0x7fe908154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 >> 172.21.15.5:0/544805603 conn(0x7fe9080b0cb0 msgr2=0x7fe9080b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 shutdown_connections 2023-11-24T07:57:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.315+0000 7fe90e291640 1 -- 172.21.15.5:0/544805603 wait complete. 2023-11-24T07:57:02.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 Processor -- start 2023-11-24T07:57:02.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 -- start start 2023-11-24T07:57:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1090144e60 0x7f10900cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10900707a0 0x7f10900b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900d05e0 con 0x7f1090070ca0 2023-11-24T07:57:02.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090145240 con 0x7f10900707a0 2023-11-24T07:57:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f1095b01640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900cf9d0 con 0x7f1090144e60 2023-11-24T07:57:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10900707a0 0x7f10900b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1090070ca0 0x7f1090070090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2023-11-24T07:57:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108effd640 1 -- 172.21.15.5:0/335853431 learned_addr learned my addr 172.21.15.5:0/335853431 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:02.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108f7fe640 1 --2- 172.21.15.5:0/335853431 >> v2:172.21.15.102:3300/0 conn(0x7f1090144e60 0x7f10900cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108ffff640 1 -- 172.21.15.5:0/335853431 >> v2:172.21.15.102:3300/0 conn(0x7f1090144e60 msgr2=0x7f10900cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108ffff640 1 --2- 172.21.15.5:0/335853431 >> v2:172.21.15.102:3300/0 conn(0x7f1090144e60 0x7f10900cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108ffff640 1 -- 172.21.15.5:0/335853431 >> v1:172.21.15.5:6789/0 conn(0x7f1090070ca0 legacy=0x7f1090070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108ffff640 1 -- 172.21.15.5:0/335853431 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900cfcb0 con 0x7f10900707a0 2023-11-24T07:57:02.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.483+0000 7f108e7fc640 1 -- 172.21.15.5:0/335853431 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207895902 0 0) 0x7f10900d05e0 con 0x7f1090070ca0 2023-11-24T07:57:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f108ffff640 1 --2- 172.21.15.5:0/335853431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10900707a0 0x7f10900b4310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10900744f0 tx=0x7f108801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c739a8541afce5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f108e7fc640 1 -- 172.21.15.5:0/335853431 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880a59a0 con 0x7f10900707a0 2023-11-24T07:57:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f108e7fc640 1 -- 172.21.15.5:0/335853431 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880a5b00 con 0x7f10900707a0 2023-11-24T07:57:02.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f108e7fc640 1 -- 172.21.15.5:0/335853431 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880a5e90 con 0x7f10900707a0 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 -- 172.21.15.5:0/335853431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10900707a0 msgr2=0x7f10900b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 --2- 172.21.15.5:0/335853431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10900707a0 0x7f10900b4310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10900744f0 tx=0x7f108801c8e0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 -- 172.21.15.5:0/335853431 shutdown_connections 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 --2- 172.21.15.5:0/335853431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10900707a0 0x7f10900b4310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 --2- 172.21.15.5:0/335853431 >> v2:172.21.15.102:3300/0 conn(0x7f1090144e60 0x7f10900cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 -- 172.21.15.5:0/335853431 >> 172.21.15.5:0/335853431 conn(0x7f10900b2f10 msgr2=0x7f10900b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 -- 172.21.15.5:0/335853431 shutdown_connections 2023-11-24T07:57:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.487+0000 7f1095b01640 1 -- 172.21.15.5:0/335853431 wait complete. 2023-11-24T07:57:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 Processor -- start 2023-11-24T07:57:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 -- start start 2023-11-24T07:57:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10900707a0 0x7f109013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1090144e60 0x7f109013f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109014f060 con 0x7f1090070ca0 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109014f340 con 0x7f10900707a0 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109014f620 con 0x7f1090144e60 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57630/0 (socket says 172.21.15.5:57630) 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 -- 172.21.15.5:0/1447933119 learned_addr learned my addr 172.21.15.5:0/1447933119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108f7fe640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10900707a0 0x7f109013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108ffff640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1090144e60 0x7f109013f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 -- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1090144e60 msgr2=0x7f109013f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1090144e60 0x7f109013f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 -- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10900707a0 msgr2=0x7f109013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10900707a0 0x7f109013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 -- 172.21.15.5:0/1447933119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009a70 con 0x7f1090070ca0 2023-11-24T07:57:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f108effd640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f108400c520 tx=0x7f108400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084007560 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10840047f0 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084004ba0 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.491+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109014f900 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109013ef60 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004e850 con 0x7f1090070ca0 2023-11-24T07:57:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1084004d00 con 0x7f1090070ca0 2023-11-24T07:57:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f1077fff640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 0x7f107c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1084082fe0 con 0x7f1090070ca0 2023-11-24T07:57:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f108f7fe640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 0x7f107c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.495+0000 7f108f7fe640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 0x7f107c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1080009ac0 tx=0x7f1080009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.499+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1084050540 con 0x7f1090070ca0 2023-11-24T07:57:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10900704a0 con 0x7f1090070ca0 2023-11-24T07:57:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1077fff640 1 -- 172.21.15.5:0/1447933119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1084018020 con 0x7f1090070ca0 2023-11-24T07:57:02.662 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 msgr2=0x7f107c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 0x7f107c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1080009ac0 tx=0x7f1080009190 comp rx=0 tx=0).stop 2023-11-24T07:57:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 msgr2=0x7f109014e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f108400c520 tx=0x7f108400c9e0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 shutdown_connections 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f107c066470 0x7f107c068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1090144e60 0x7f109013f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1090070ca0 0x7f109014e680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 --2- 172.21.15.5:0/1447933119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10900707a0 0x7f109013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 >> 172.21.15.5:0/1447933119 conn(0x7f10900b2f10 msgr2=0x7f109015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 shutdown_connections 2023-11-24T07:57:02.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.659+0000 7f1095b01640 1 -- 172.21.15.5:0/1447933119 wait complete. 2023-11-24T07:57:02.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 Processor -- start 2023-11-24T07:57:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 -- start start 2023-11-24T07:57:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bdc15d530 0x7f3bdc0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0d12e0 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc0d15c0 con 0x7f3bdc15d530 2023-11-24T07:57:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be25df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0d18a0 con 0x7f3bdc0d04c0 2023-11-24T07:57:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bdc0cf1b0 0x7f3bdc0cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46058/0 (socket says 172.21.15.5:46058) 2023-11-24T07:57:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdb7fe640 1 -- 172.21.15.5:0/832272041 learned_addr learned my addr 172.21.15.5:0/832272041 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/832272041 >> v2:172.21.15.5:3300/0 conn(0x7f3bdc15d530 0x7f3bdc0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3be0b7c640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdbfff640 1 -- 172.21.15.5:0/832272041 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 msgr2=0x7f3bdc1674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc1674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdbfff640 1 -- 172.21.15.5:0/832272041 >> v1:172.21.15.5:6789/0 conn(0x7f3bdc0cf1b0 legacy=0x7f3bdc0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdbfff640 1 -- 172.21.15.5:0/832272041 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0d1b80 con 0x7f3bdc15d530 2023-11-24T07:57:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.823+0000 7f3bdaffd640 1 -- 172.21.15.5:0/832272041 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598891969 0 0) 0x7f3bdc0d12e0 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc0cec70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0097f0 tx=0x7f3bcc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64768a4633077987 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3bdaffd640 1 -- 172.21.15.5:0/832272041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0a8970 con 0x7f3bdc15d530 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3bdaffd640 1 -- 172.21.15.5:0/832272041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc0a8ad0 con 0x7f3bdc15d530 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3bdaffd640 1 -- 172.21.15.5:0/832272041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0a8e60 con 0x7f3bdc15d530 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 -- 172.21.15.5:0/832272041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 msgr2=0x7f3bdc0cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc0cec70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0097f0 tx=0x7f3bcc01ec70 comp rx=0 tx=0).stop 2023-11-24T07:57:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 -- 172.21.15.5:0/832272041 shutdown_connections 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc1674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 --2- 172.21.15.5:0/832272041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc0cec70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 -- 172.21.15.5:0/832272041 >> 172.21.15.5:0/832272041 conn(0x7f3bdc09c6d0 msgr2=0x7f3bdc0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 -- 172.21.15.5:0/832272041 shutdown_connections 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.827+0000 7f3be25df640 1 -- 172.21.15.5:0/832272041 wait complete. 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 Processor -- start 2023-11-24T07:57:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- start start 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 0x7f3bdc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc15e560 con 0x7f3bdc15d530 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0b6520 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0b67f0 con 0x7f3bdc0d04c0 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be0b7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 0x7f3bdc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be0b7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57640/0 (socket says 172.21.15.5:57640) 2023-11-24T07:57:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be0b7c640 1 -- 172.21.15.5:0/610842933 learned_addr learned my addr 172.21.15.5:0/610842933 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdb7fe640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 -- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 msgr2=0x7f3bdc0b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc0b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 -- 172.21.15.5:0/610842933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 msgr2=0x7f3bdc15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 -- 172.21.15.5:0/610842933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009420 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be0b7c640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bdbfff640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 0x7f3bdc0cc6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0af000 tx=0x7f3bcc01d4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0a8970 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc006e20 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc004220 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc0b6ad0 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.831+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc0b7090 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.835+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc04e850 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.835+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bcc004380 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.835+0000 7f3bd8ff9640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 0x7f3bc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.835+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bcc1228f0 con 0x7f3bdc0cf1b0 2023-11-24T07:57:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.835+0000 7f3bdb7fe640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 0x7f3bc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:02.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.839+0000 7f3bdb7fe640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 0x7f3bc8068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0c9be0 tx=0x7f3bd0007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:02.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:02.839+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bcc0efff0 con 0x7f3bdc0cf1b0 2023-11-24T07:57:03.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.031+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bdc0cf980 con 0x7f3bdc0cf1b0 2023-11-24T07:57:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.031+0000 7f3bd8ff9640 1 -- 172.21.15.5:0/610842933 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f3bcc0f3610 con 0x7f3bdc0cf1b0 2023-11-24T07:57:03.035 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:03.035 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:03.035 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 msgr2=0x7f3bc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 0x7f3bc8068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0c9be0 tx=0x7f3bd0007d60 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 msgr2=0x7f3bdc0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 0x7f3bdc0cc6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0af000 tx=0x7f3bcc01d4b0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 shutdown_connections 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3bc8066470 0x7f3bc8068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bdc15d530 0x7f3bdc15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc0d04c0 0x7f3bdc0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 --2- 172.21.15.5:0/610842933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0cf1b0 0x7f3bdc0cc6b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 >> 172.21.15.5:0/610842933 conn(0x7f3bdc09c6d0 msgr2=0x7f3bdc0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 shutdown_connections 2023-11-24T07:57:03.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.035+0000 7f3be25df640 1 -- 172.21.15.5:0/610842933 wait complete. 2023-11-24T07:57:03.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.195+0000 7f2b299a1640 1 Processor -- start 2023-11-24T07:57:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.195+0000 7f2b299a1640 1 -- start start 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2415f540 0x7f2b240b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b240b1f40 0x7f2b2406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 0x7f2b2406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240b2920 con 0x7f2b240b1f40 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240b2c00 con 0x7f2b240b23c0 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b299a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240b2ee0 con 0x7f2b2415f540 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b240b1f40 0x7f2b2406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b240b1f40 0x7f2b2406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57644/0 (socket says 172.21.15.5:57644) 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 -- 172.21.15.5:0/2795691461 learned_addr learned my addr 172.21.15.5:0/2795691461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b22ffd640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2415f540 0x7f2b240b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b237fe640 1 --2- 172.21.15.5:0/2795691461 >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 0x7f2b2406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 -- 172.21.15.5:0/2795691461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2415f540 msgr2=0x7f2b240b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2415f540 0x7f2b240b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 -- 172.21.15.5:0/2795691461 >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 msgr2=0x7f2b2406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 --2- 172.21.15.5:0/2795691461 >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 0x7f2b2406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b1bfff640 1 -- 172.21.15.5:0/2795691461 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240b31c0 con 0x7f2b240b1f40 2023-11-24T07:57:03.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.199+0000 7f2b237fe640 1 --2- 172.21.15.5:0/2795691461 >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 0x7f2b2406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b1bfff640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b240b1f40 0x7f2b2406c630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b2406c150 tx=0x7f2b0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f72b9e62c50a5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b227fc640 1 -- 172.21.15.5:0/2795691461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0aa610 con 0x7f2b240b1f40 2023-11-24T07:57:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b227fc640 1 -- 172.21.15.5:0/2795691461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c0a6040 con 0x7f2b240b1f40 2023-11-24T07:57:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b227fc640 1 -- 172.21.15.5:0/2795691461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0aa990 con 0x7f2b240b1f40 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- 172.21.15.5:0/2795691461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b240b1f40 msgr2=0x7f2b2406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b240b1f40 0x7f2b2406c630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b2406c150 tx=0x7f2b0c01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- 172.21.15.5:0/2795691461 shutdown_connections 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 --2- 172.21.15.5:0/2795691461 >> v2:172.21.15.102:3300/0 conn(0x7f2b240b23c0 0x7f2b2406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b240b1f40 0x7f2b2406c630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 --2- 172.21.15.5:0/2795691461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2415f540 0x7f2b240b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- 172.21.15.5:0/2795691461 >> 172.21.15.5:0/2795691461 conn(0x7f2b240b0c40 msgr2=0x7f2b240b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- 172.21.15.5:0/2795691461 shutdown_connections 2023-11-24T07:57:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- 172.21.15.5:0/2795691461 wait complete. 2023-11-24T07:57:03.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 Processor -- start 2023-11-24T07:57:03.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.203+0000 7f2b299a1640 1 -- start start 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 0x7f2b24099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 0x7f2b24152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24158150 con 0x7f2b2415f540 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24152890 con 0x7f2b240b1f40 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241574d0 con 0x7f2b240b23c0 2023-11-24T07:57:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57656/0 (socket says 172.21.15.5:57656) 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 -- 172.21.15.5:0/3989103177 learned_addr learned my addr 172.21.15.5:0/3989103177 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b22ffd640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 0x7f2b24099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b1bfff640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 0x7f2b24152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 -- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 msgr2=0x7f2b24152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 0x7f2b24152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 -- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 msgr2=0x7f2b24099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 0x7f2b24099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 -- 172.21.15.5:0/3989103177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0094d0 con 0x7f2b2415f540 2023-11-24T07:57:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b1bfff640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 0x7f2b24152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b22ffd640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 0x7f2b24099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b237fe640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c007ef0 tx=0x7f2b1c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c003ba0 con 0x7f2b2415f540 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c00f040 con 0x7f2b2415f540 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00de80 con 0x7f2b2415f540 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b241577b0 con 0x7f2b2415f540 2023-11-24T07:57:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b24157d70 con 0x7f2b2415f540 2023-11-24T07:57:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24158290 con 0x7f2b2415f540 2023-11-24T07:57:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.207+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b1c004030 con 0x7f2b2415f540 2023-11-24T07:57:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.211+0000 7f2b20ff9640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 0x7f2b04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.211+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b1c084200 con 0x7f2b2415f540 2023-11-24T07:57:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.211+0000 7f2b22ffd640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 0x7f2b04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.211+0000 7f2b22ffd640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 0x7f2b04068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400b970 tx=0x7f2b14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.215+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b24158290 con 0x7f2b2415f540 2023-11-24T07:57:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.371+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b24158290 con 0x7f2b2415f540 2023-11-24T07:57:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.371+0000 7f2b20ff9640 1 -- 172.21.15.5:0/3989103177 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f2b24158290 con 0x7f2b2415f540 2023-11-24T07:57:03.376 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:03.376 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 msgr2=0x7f2b04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 0x7f2b04068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400b970 tx=0x7f2b14008040 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 msgr2=0x7f2b240afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c007ef0 tx=0x7f2b1c00d4a0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 shutdown_connections 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2b04066470 0x7f2b04068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b2415f540 0x7f2b240afc10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b240b23c0 0x7f2b24152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 --2- 172.21.15.5:0/3989103177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b240b1f40 0x7f2b24099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 >> 172.21.15.5:0/3989103177 conn(0x7f2b240b0c40 msgr2=0x7f2b240b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 shutdown_connections 2023-11-24T07:57:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.375+0000 7f2b299a1640 1 -- 172.21.15.5:0/3989103177 wait complete. 2023-11-24T07:57:03.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 Processor -- start 2023-11-24T07:57:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 -- start start 2023-11-24T07:57:03.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6ce806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce806e950 con 0x7f6ce80adcc0 2023-11-24T07:57:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce8070670 con 0x7f6ce8143ae0 2023-11-24T07:57:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cf05df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ae820 con 0x7f6ce806dfd0 2023-11-24T07:57:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ce80adcc0 0x7f6ce80ae110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2023-11-24T07:57:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 -- 172.21.15.5:0/229393231 learned_addr learned my addr 172.21.15.5:0/229393231 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cedb7a640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6ce806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959946465 0 0) 0x7f6ce806e950 con 0x7f6ce80adcc0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd4005740 con 0x7f6ce80adcc0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982182042 0 0) 0x7f6cd4005740 con 0x7f6ce80adcc0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 msgr2=0x7f6ce806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6ce806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 >> v1:172.21.15.102:6789/0 conn(0x7f6ce8143ae0 legacy=0x7f6ce80b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8070950 con 0x7f6ce80adcc0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f6ce0001a00 con 0x7f6ce80adcc0 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 >> v1:172.21.15.5:6789/0 conn(0x7f6ce80adcc0 legacy=0x7f6ce80ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4005bc0 0x7f6cd4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6cd40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd4006f20 0x7f6cd40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ae820 con 0x7f6cd4006f20 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400dcb0 con 0x7f6cd4005bc0 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400de70 con 0x7f6ce806dfd0 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cee37b640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4005bc0 0x7f6cd4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd4006f20 0x7f6cd40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cedb7a640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6cd40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 -- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 msgr2=0x7f6cd40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce806dfd0 0x7f6cd40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 -- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4005bc0 msgr2=0x7f6cd4005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4005bc0 0x7f6cd4005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6ceeb7c640 1 -- 172.21.15.5:0/229393231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4005740 con 0x7f6cd4006f20 2023-11-24T07:57:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.539+0000 7f6cee37b640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4005bc0 0x7f6cd4005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6ceeb7c640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd4006f20 0x7f6cd40073a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0002240 tx=0x7f6ce001d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa26b8e89fd48115 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00ad630 con 0x7f6cd4006f20 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00a8070 con 0x7f6cd4006f20 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6ced379640 1 -- 172.21.15.5:0/229393231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00ada10 con 0x7f6cd4006f20 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 -- 172.21.15.5:0/229393231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd4006f20 msgr2=0x7f6cd40073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 --2- 172.21.15.5:0/229393231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd4006f20 0x7f6cd40073a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0002240 tx=0x7f6ce001d240 comp rx=0 tx=0).stop 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6ceeb7c640 1 -- 172.21.15.5:0/229393231 reap_dead start 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 -- 172.21.15.5:0/229393231 shutdown_connections 2023-11-24T07:57:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 -- 172.21.15.5:0/229393231 >> 172.21.15.5:0/229393231 conn(0x7f6ce80b0c40 msgr2=0x7f6ce80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 -- 172.21.15.5:0/229393231 shutdown_connections 2023-11-24T07:57:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.543+0000 7f6cf05df640 1 -- 172.21.15.5:0/229393231 wait complete. 2023-11-24T07:57:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 Processor -- start 2023-11-24T07:57:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- start start 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4006f20 0x7f6ce809b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce80cd0e0 0x7f6ce80ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81f4310 con 0x7f6ce80ccc60 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80cbf00 con 0x7f6cd4006f20 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81f4030 con 0x7f6ce80cd0e0 2023-11-24T07:57:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57678/0 (socket says 172.21.15.5:57678) 2023-11-24T07:57:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 -- 172.21.15.5:0/2785469668 learned_addr learned my addr 172.21.15.5:0/2785469668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cee37b640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4006f20 0x7f6ce809b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6ceeb7c640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce80cd0e0 0x7f6ce80ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 -- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce80cd0e0 msgr2=0x7f6ce80ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce80cd0e0 0x7f6ce80ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 -- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4006f20 msgr2=0x7f6ce809b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4006f20 0x7f6ce809b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 -- 172.21.15.5:0/2785469668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80cc180 con 0x7f6ce80ccc60 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cedb7a640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8011a00 tx=0x7f6cd8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800faf0 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800fc50 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8014440 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce80cc460 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.547+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80c82c0 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce804e850 con 0x7f6ce80ccc60 2023-11-24T07:57:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6cd80145a0 con 0x7f6ce80ccc60 2023-11-24T07:57:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cdeffd640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd80845d0 con 0x7f6ce80ccc60 2023-11-24T07:57:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cee37b640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.551+0000 7f6cee37b640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 0x7f6ccc068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4001370 tx=0x7f6ce4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.555+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cd8051b00 con 0x7f6ce80ccc60 2023-11-24T07:57:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ce80b1330 con 0x7f6ce80ccc60 2023-11-24T07:57:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cdeffd640 1 -- 172.21.15.5:0/2785469668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6cd8055120 con 0x7f6ce80ccc60 2023-11-24T07:57:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:03.747 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 msgr2=0x7f6ccc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 0x7f6ccc068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4001370 tx=0x7f6ce4009040 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 msgr2=0x7f6ce80c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.743+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8011a00 tx=0x7f6cd8011ec0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 shutdown_connections 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ce80cd0e0 0x7f6ce80ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ce80ccc60 0x7f6ce80c9ee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 --2- 172.21.15.5:0/2785469668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6cd4006f20 0x7f6ce809b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 >> 172.21.15.5:0/2785469668 conn(0x7f6ce80b0c40 msgr2=0x7f6ce80aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 shutdown_connections 2023-11-24T07:57:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:03.747+0000 7f6cf05df640 1 -- 172.21.15.5:0/2785469668 wait complete. 2023-11-24T07:57:04.170 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T07:56:49.369605+0000', 'modified': '2023-11-24T07:56:52.375988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6837/3914236493', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6835', 'nonce': 3914236493}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 3914236493}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T07:57:04.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T07:57:04.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T07:57:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 Processor -- start 2023-11-24T07:57:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 -- start start 2023-11-24T07:57:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40200b5830 0x7f402015e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200af630 con 0x7f40200ad8e0 2023-11-24T07:57:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200acb10 con 0x7f40200acd70 2023-11-24T07:57:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.315+0000 7f402812a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40200ae5b0 con 0x7f40200b5830 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40200b5830 0x7f402015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f40266c7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40200ad8e0 0x7f402006d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46076/0 (socket says 172.21.15.5:46076) 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f40266c7640 1 -- 172.21.15.5:0/3884824716 learned_addr learned my addr 172.21.15.5:0/3884824716 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40200b5830 0x7f402015e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57680/0 (socket says 172.21.15.5:57680) 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 -- 172.21.15.5:0/3884824716 >> v1:172.21.15.102:6789/0 conn(0x7f40200acd70 legacy=0x7f40200ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 -- 172.21.15.5:0/3884824716 >> v1:172.21.15.5:6789/0 conn(0x7f40200ad8e0 legacy=0x7f402006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 -- 172.21.15.5:0/3884824716 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200ae870 con 0x7f40200b5830 2023-11-24T07:57:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4025ec6640 1 --2- 172.21.15.5:0/3884824716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200b5830 0x7f402015e690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f401c0097c0 tx=0x7f401c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82048d91ea05d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4024ec4640 1 -- 172.21.15.5:0/3884824716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0ab680 con 0x7f40200b5830 2023-11-24T07:57:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4024ec4640 1 -- 172.21.15.5:0/3884824716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c0ab7e0 con 0x7f40200b5830 2023-11-24T07:57:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.319+0000 7f4024ec4640 1 -- 172.21.15.5:0/3884824716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0abb70 con 0x7f40200b5830 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- 172.21.15.5:0/3884824716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200b5830 msgr2=0x7f402015e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 --2- 172.21.15.5:0/3884824716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200b5830 0x7f402015e690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f401c0097c0 tx=0x7f401c01c480 comp rx=0 tx=0).stop 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- 172.21.15.5:0/3884824716 shutdown_connections 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 --2- 172.21.15.5:0/3884824716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200b5830 0x7f402015e690 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- 172.21.15.5:0/3884824716 >> 172.21.15.5:0/3884824716 conn(0x7f4020071d80 msgr2=0x7f402006a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- 172.21.15.5:0/3884824716 shutdown_connections 2023-11-24T07:57:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- 172.21.15.5:0/3884824716 wait complete. 2023-11-24T07:57:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 Processor -- start 2023-11-24T07:57:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- start start 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40200acd70 0x7f40201543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 0x7f402015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020153db0 con 0x7f40200ad8e0 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402014cb90 con 0x7f40200b5830 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f402812a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40201568e0 con 0x7f40200acd70 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f40256c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f4025ec6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40200acd70 0x7f40201543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f40256c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57692/0 (socket says 172.21.15.5:57692) 2023-11-24T07:57:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f40256c5640 1 -- 172.21.15.5:0/294515763 learned_addr learned my addr 172.21.15.5:0/294515763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.323+0000 7f40266c7640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 0x7f402015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 -- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40200acd70 msgr2=0x7f40201543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40200acd70 0x7f40201543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 -- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 msgr2=0x7f402015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 0x7f402015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 -- 172.21.15.5:0/294515763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009420 con 0x7f40200ad8e0 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40266c7640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 0x7f402015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40256c5640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f401000c3f0 tx=0x7f401000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 -- 172.21.15.5:0/294515763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100052d0 con 0x7f40200ad8e0 2023-11-24T07:57:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 -- 172.21.15.5:0/294515763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010005430 con 0x7f40200ad8e0 2023-11-24T07:57:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 -- 172.21.15.5:0/294515763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010003840 con 0x7f40200ad8e0 2023-11-24T07:57:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4020156bc0 con 0x7f40200ad8e0 2023-11-24T07:57:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4020157180 con 0x7f40200ad8e0 2023-11-24T07:57:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 -- 172.21.15.5:0/294515763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40100039a0 con 0x7f40200ad8e0 2023-11-24T07:57:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 0x7f4004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.327+0000 7f40167fc640 1 -- 172.21.15.5:0/294515763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4010083350 con 0x7f40200ad8e0 2023-11-24T07:57:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 Processor -- start 2023-11-24T07:57:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f4025ec6640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 0x7f4004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- start start 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f4025ec6640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 0x7f4004068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f401c0af000 tx=0x7f401c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x565480327070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565480147130 con 0x5654802dd320 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654801349a0 con 0x5654803275b0 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x565480131ed0 con 0x565480326c90 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57694/0 (socket says 172.21.15.5:57694) 2023-11-24T07:57:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 -- 172.21.15.5:0/823945810 learned_addr learned my addr 172.21.15.5:0/823945810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40256c5640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f4025ec6640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x565480327070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 -- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 msgr2=0x565480327070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x565480327070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 -- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 msgr2=0x5654802dcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802dcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 -- 172.21.15.5:0/823945810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56547fe25890 con 0x5654802dd320 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40256c5640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802dcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40266c7640 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f401800f630 tx=0x7f4018001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bedd7aa0847a79 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40037fe640 1 -- 172.21.15.5:0/823945810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018007320 con 0x5654802dd320 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40037fe640 1 -- 172.21.15.5:0/823945810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018007480 con 0x5654802dd320 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f40037fe640 1 -- 172.21.15.5:0/823945810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180077f0 con 0x5654802dd320 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- 172.21.15.5:0/823945810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 msgr2=0x5654802dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f401800f630 tx=0x7f4018001a00 comp rx=0 tx=0).stop 2023-11-24T07:57:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- 172.21.15.5:0/823945810 shutdown_connections 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802dd700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802dcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 --2- 172.21.15.5:0/823945810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x565480327070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- 172.21.15.5:0/823945810 >> 172.21.15.5:0/823945810 conn(0x5654802d92d0 msgr2=0x5654802db6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- 172.21.15.5:0/823945810 shutdown_connections 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.331+0000 7f402b4ad000 1 -- 172.21.15.5:0/823945810 wait complete. 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- start start 2023-11-24T07:57:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 Processor -- start 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x5654802e2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802f5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548012d7c0 con 0x5654802dd320 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654800e5bf0 con 0x5654803275b0 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654800eba90 con 0x565480326c90 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 10 client.0 _ll_register_callbacks cb 0x5654802c83c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57702/0 (socket says 172.21.15.5:57702) 2023-11-24T07:57:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 -- 172.21.15.5:0/1412664398 learned_addr learned my addr 172.21.15.5:0/1412664398 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f40266c7640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f40256c5640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x5654802e2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 -- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 msgr2=0x5654802e2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x5654802e2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 -- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 msgr2=0x5654802f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 -- 172.21.15.5:0/1412664398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4020157180 con 0x5654802dd320 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4025ec6640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f401c01c960 tx=0x7f401c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a08670d937139 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0c7070 con 0x5654802dd320 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f401c0c29e0 con 0x5654802dd320 2023-11-24T07:57:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654800ef470 con 0x5654802dd320 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f401c0c2ba0 con 0x5654802dd320 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 10 client.4662 fetch_fsmap learned FSMap version 8 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f401800f2b0 con 0x5654802dd320 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654800ef470 con 0x5654802dd320 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f401c0c2d00 con 0x5654802dd320 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 20 client.4662 populate_metadata read hostname 'smithi005' 2023-11-24T07:57:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x5654802f6320 0x565480338f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 4 client.4662 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T07:57:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.335+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 --> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654800f2b50 con 0x5654802f6320 2023-11-24T07:57:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f40256c5640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x5654802f6320 0x565480338f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f40256c5640 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x5654802f6320 0x565480338f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c28d574090a7b41 server_cookie=d09773094ba883b3 in_seq=0 out_seq=0 2023-11-24T07:57:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f4000ff9640 10 client.4662 ms_handle_connect on v2:172.21.15.102:6835/3914236493 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f4000ff9640 1 -- 172.21.15.5:0/1412664398 <== mds.0 v2:172.21.15.102:6835/3914236493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654800f2b50 con 0x5654802f6320 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f4000ff9640 10 client.4662 handle_command_reply: tid=0 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 client.4662 shutdown 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 msgr2=0x5654802e1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f401c01c960 tx=0x7f401c01acc0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 shutdown_connections 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x5654802f6320 0x565480338f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x5654802f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x565480326c90 0x5654802e2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 --2- 172.21.15.5:0/1412664398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x5654802e1d40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f4000ff9640 0 client.4662 ms_handle_reset on v2:172.21.15.102:6835/3914236493 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 >> 172.21.15.5:0/1412664398 conn(0x5654802d92d0 msgr2=0x5654802db6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 shutdown_connections 2023-11-24T07:57:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 1 -- 172.21.15.5:0/1412664398 wait complete. 2023-11-24T07:57:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.339+0000 7f402b4ad000 20 client.4662 trim_cache size 0 max 16384 2023-11-24T07:57:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 Processor -- start 2023-11-24T07:57:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 -- start start 2023-11-24T07:57:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 0x565480324b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654803275b0 0x565480325070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56547fde6940 con 0x5654802dd320 2023-11-24T07:57:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548012abc0 con 0x565480326c90 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x56548012c650 con 0x5654803275b0 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57704/0 (socket says 172.21.15.5:57704) 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 -- 172.21.15.5:0/151635375 learned_addr learned my addr 172.21.15.5:0/151635375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 -- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654803275b0 msgr2=0x565480325070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654803275b0 0x565480325070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f4025ec6640 1 -- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 msgr2=0x565480324b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.355+0000 7f40256c5640 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 0x565480324b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4025ec6640 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 0x565480324b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4025ec6640 1 -- 172.21.15.5:0/151635375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654800ee190 con 0x5654802dd320 2023-11-24T07:57:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f40256c5640 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 0x565480324b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4025ec6640 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f401c0bb040 tx=0x7f401c0c7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a710b6d7dc43e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4003fff640 1 -- 172.21.15.5:0/151635375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0c2be0 con 0x5654802dd320 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4003fff640 1 -- 172.21.15.5:0/151635375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c0c2d40 con 0x5654802dd320 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4003fff640 1 -- 172.21.15.5:0/151635375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0cb910 con 0x5654802dd320 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- 172.21.15.5:0/151635375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 msgr2=0x565480325c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f401c0bb040 tx=0x7f401c0c7000 comp rx=0 tx=0).stop 2023-11-24T07:57:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- 172.21.15.5:0/151635375 shutdown_connections 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654803275b0 0x565480325070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x565480326c90 0x565480324b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- 172.21.15.5:0/151635375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654802dd320 0x565480325c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- 172.21.15.5:0/151635375 >> 172.21.15.5:0/151635375 conn(0x5654802d92d0 msgr2=0x565480334280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- 172.21.15.5:0/151635375 shutdown_connections 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- 172.21.15.5:0/151635375 wait complete. 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- start start 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 Processor -- start 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654802dd320 0x5654802dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x56548033a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654800c88a0 con 0x565480326c90 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654802e2fb0 con 0x5654803275b0 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654800f72e0 con 0x5654802dd320 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f402b4ad000 10 client.0 _ll_register_callbacks cb 0x56548017bc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f40256c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f40256c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57710/0 (socket says 172.21.15.5:57710) 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f40256c5640 1 -- 172.21.15.5:0/3923423572 learned_addr learned my addr 172.21.15.5:0/3923423572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f4025ec6640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654802dd320 0x5654802dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.359+0000 7f40266c7640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x56548033a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 -- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654802dd320 msgr2=0x5654802dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654802dd320 0x5654802dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 -- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 msgr2=0x56548033a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x56548033a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 -- 172.21.15.5:0/3923423572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401800f2b0 con 0x565480326c90 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f40256c5640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4010081810 tx=0x7f401001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faacd3da6661dfed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100830b0 con 0x565480326c90 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4010050c40 con 0x565480326c90 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56548012c110 con 0x565480326c90 2023-11-24T07:57:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4010050e20 con 0x565480326c90 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 10 client.4668 fetch_fsmap learned FSMap version 8 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5654800d4490 con 0x565480326c90 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56548012c110 con 0x565480326c90 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f401006b070 con 0x565480326c90 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 20 client.4668 populate_metadata read hostname 'smithi005' 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x565480387010 0x5654803873f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 4 client.4668 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T07:57:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 --> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56548015b9a0 con 0x565480387010 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4025ec6640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x565480387010 0x5654803873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4025ec6640 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x565480387010 0x5654803873f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a3f26f06732886 server_cookie=9ea8adc52db0b9e1 in_seq=0 out_seq=0 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 10 client.4668 ms_handle_connect on v2:172.21.15.102:6835/3914236493 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 1 -- 172.21.15.5:0/3923423572 <== mds.0 v2:172.21.15.102:6835/3914236493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56548015b9a0 con 0x565480387010 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 10 client.4668 handle_command_reply: tid=0 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 client.4668 shutdown 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 msgr2=0x565480339fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4010081810 tx=0x7f401001e040 comp rx=0 tx=0).stop 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 shutdown_connections 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:6835/3914236493,v1:172.21.15.102:6837/3914236493] conn(0x565480387010 0x5654803873f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654803275b0 0x56548033a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565480326c90 0x565480339fa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 --2- 172.21.15.5:0/3923423572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5654802dd320 0x5654802dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f4000ff9640 0 client.4668 ms_handle_reset on v2:172.21.15.102:6835/3914236493 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 >> 172.21.15.5:0/3923423572 conn(0x5654802d92d0 msgr2=0x5654802db6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 shutdown_connections 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 1 -- 172.21.15.5:0/3923423572 wait complete. 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402b4ad000 20 client.4668 trim_cache size 0 max 16384 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:57:04.377 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c1c5da79-7f10-46d9-a2ce-04e64f4e6baf", 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4296, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 14.384028603999999, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 8, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 20, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 20, 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21.765690962000001 2023-11-24T07:57:04.378 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:57:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 msgr2=0x7f4004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 0x7f4004068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f401c0af000 tx=0x7f401c0a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 msgr2=0x7f402014c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f401000c3f0 tx=0x7f401000c8b0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 shutdown_connections 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4004066470 0x7f4004068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200b5830 0x7f402015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40200ad8e0 0x7f402014c650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 --2- 172.21.15.5:0/294515763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40200acd70 0x7f40201543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 >> 172.21.15.5:0/294515763 conn(0x7f4020071d80 msgr2=0x7f4020153210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.363+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 shutdown_connections 2023-11-24T07:57:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.367+0000 7f402812a640 1 -- 172.21.15.5:0/294515763 wait complete. 2023-11-24T07:57:04.387 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T07:57:04.411 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T07:57:04.411 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T07:57:04.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.412 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:57:04.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:57:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-11-24T07:57:04.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:57:04.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.494 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:57:04.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:57:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-11-24T07:57:04.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:57:04.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.614 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:57:04.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:57:04.692 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-24T07:57:04.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:57:04.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.695 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:57:04.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:04.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:57:04.812 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-24T07:57:04.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:57:04.814 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-24T07:57:04.814 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T07:57:04.814 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:04.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 Processor -- start 2023-11-24T07:57:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 -- start start 2023-11-24T07:57:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f730815d7b0 0x7f73080d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73080cefd0 con 0x7f73080d1eb0 2023-11-24T07:57:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080d2340 con 0x7f730815d7b0 2023-11-24T07:57:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f7310335640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080cf2b0 con 0x7f73080cead0 2023-11-24T07:57:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e8d2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73080d1eb0 0x7f73080cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46086/0 (socket says 172.21.15.5:46086) 2023-11-24T07:57:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e8d2640 1 -- 172.21.15.5:0/1072643234 learned_addr learned my addr 172.21.15.5:0/1072643234 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e0d1640 1 --2- 172.21.15.5:0/1072643234 >> v2:172.21.15.102:3300/0 conn(0x7f730815d7b0 0x7f73080d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730d8d0640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730d0cf640 1 -- 172.21.15.5:0/1072643234 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200403528 0 0) 0x7f73080cefd0 con 0x7f73080d1eb0 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730d0cf640 1 -- 172.21.15.5:0/1072643234 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003530 con 0x7f73080d1eb0 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e0d1640 1 -- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 msgr2=0x7f73080d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e0d1640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e0d1640 1 -- 172.21.15.5:0/1072643234 >> v1:172.21.15.5:6789/0 conn(0x7f73080d1eb0 legacy=0x7f73080cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.955+0000 7f730e0d1640 1 -- 172.21.15.5:0/1072643234 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730806b3f0 con 0x7f730815d7b0 2023-11-24T07:57:04.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f730e0d1640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f73080d10d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73040097c0 tx=0x7f730401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f3257ffe79623b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f730d0cf640 1 -- 172.21.15.5:0/1072643234 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040ab600 con 0x7f730815d7b0 2023-11-24T07:57:04.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f730d0cf640 1 -- 172.21.15.5:0/1072643234 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040a7050 con 0x7f730815d7b0 2023-11-24T07:57:04.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f730d0cf640 1 -- 172.21.15.5:0/1072643234 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040ab980 con 0x7f730815d7b0 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 -- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 msgr2=0x7f73080d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f73080d10d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73040097c0 tx=0x7f730401c330 comp rx=0 tx=0).stop 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 -- 172.21.15.5:0/1072643234 shutdown_connections 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 --2- 172.21.15.5:0/1072643234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f73080d10d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 -- 172.21.15.5:0/1072643234 >> 172.21.15.5:0/1072643234 conn(0x7f73080d33b0 msgr2=0x7f73080d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 -- 172.21.15.5:0/1072643234 shutdown_connections 2023-11-24T07:57:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.959+0000 7f7310335640 1 -- 172.21.15.5:0/1072643234 wait complete. 2023-11-24T07:57:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 Processor -- start 2023-11-24T07:57:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- start start 2023-11-24T07:57:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f7308158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080ccef0 con 0x7f73080d1eb0 2023-11-24T07:57:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080cbee0 con 0x7f730815d7b0 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080cc130 con 0x7f73080cead0 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57714/0 (socket says 172.21.15.5:57714) 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 -- 172.21.15.5:0/2443095872 learned_addr learned my addr 172.21.15.5:0/2443095872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730e0d1640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730e8d2640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f7308158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 -- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 msgr2=0x7f73080c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 -- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 msgr2=0x7f7308158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f7308158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 -- 172.21.15.5:0/2443095872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304009420 con 0x7f73080d1eb0 2023-11-24T07:57:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f730d8d0640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e870 tx=0x7f72f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009510 con 0x7f73080d1eb0 2023-11-24T07:57:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800eec0 con 0x7f73080d1eb0 2023-11-24T07:57:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080cc410 con 0x7f73080d1eb0 2023-11-24T07:57:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800cb40 con 0x7f73080d1eb0 2023-11-24T07:57:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.963+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73080cc9d0 con 0x7f73080d1eb0 2023-11-24T07:57:04.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73080ccb90 con 0x7f73080d1eb0 2023-11-24T07:57:04.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72f800cca0 con 0x7f73080d1eb0 2023-11-24T07:57:04.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f72feffd640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:04.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72f8083f00 con 0x7f73080d1eb0 2023-11-24T07:57:04.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f730e0d1640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:04.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.967+0000 7f730e0d1640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 0x7f72ec068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:04.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:04.971+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72f8051420 con 0x7f73080d1eb0 2023-11-24T07:57:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f730804e850 con 0x7f73080d1eb0 2023-11-24T07:57:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f72feffd640 1 -- 172.21.15.5:0/2443095872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72f8017060 con 0x7f73080d1eb0 2023-11-24T07:57:05.170 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 msgr2=0x7f72ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 0x7f72ec068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f73040ad000 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 msgr2=0x7f73080c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.167+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e870 tx=0x7f72f800ec70 comp rx=0 tx=0).stop 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 shutdown_connections 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f730815d7b0 0x7f7308158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73080d1eb0 0x7f73080c7420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:05.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 --2- 172.21.15.5:0/2443095872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73080cead0 0x7f73080c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 >> 172.21.15.5:0/2443095872 conn(0x7f73080d33b0 msgr2=0x7f73080b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 shutdown_connections 2023-11-24T07:57:05.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:05.171+0000 7f7310335640 1 -- 172.21.15.5:0/2443095872 wait complete. 2023-11-24T07:57:05.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T07:57:05.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:05.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-11-24T07:57:05.192 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T07:57:05.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:05.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T07:57:05.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T07:57:05.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:05.193 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T07:57:05.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.194 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-11-24T07:57:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:05.204 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:05.205 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:be:f5:01:bf brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:05.206 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:05.207 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T07:57:05.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T07:57:05.208 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:05.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.320 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:05.339 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-11-24T07:57:05.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.342 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-11-24T07:57:05.414 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-11-24T07:57:05.414 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:05.415 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T07:57:05.415 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:05.415 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T07:57:05.415 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:05.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T07:57:05.416 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:05.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.508 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:57:05.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.519 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-11-24T07:57:05.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.574 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:05.574 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:05.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T07:57:05.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T07:57:05.575 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:05.662 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T07:57:05.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T07:57:05.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T07:57:05.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T07:57:05.664 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:05.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.824 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:05.824 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:05.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-11-24T07:57:05.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T07:57:05.824 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:05.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:05.866 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:05.917 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T07:57:05.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:05.917 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:05.972 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:05.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:05.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:06.082 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:06.082 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:06.082 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:06.193 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:06.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:06.194 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:06.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:06.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:06.207 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:06.207 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:06.210 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:06.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:06.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.232 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:06.305 INFO:teuthology.orchestra.run.smithi005.stdout:client4511 2023-11-24T07:57:06.305 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:06.306 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:06.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.357 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:06.421 INFO:teuthology.orchestra.run.smithi005.stdout:client4511 2023-11-24T07:57:06.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.422 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:06.488 INFO:teuthology.orchestra.run.smithi005.stdout:client4511 2023-11-24T07:57:06.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1c5da79-7f10-46d9-a2ce-04e64f4e6baf.client4511/status') 2023-11-24T07:57:06.557 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4511 (3)172.21.15.5:0/3268628038 2023-11-24T07:57:06.558 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-11-24T07:57:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-11-24T07:57:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-11-24T07:57:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 5.4403e-05 s, 1.3 MB/s 2023-11-24T07:57:06.560 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-24T07:57:06.560 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T07:57:06.560 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T07:57:06.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 Processor -- start 2023-11-24T07:57:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 -- start start 2023-11-24T07:57:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48b015d7b0 0x7f48b00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f48b00d2080 0x7f48b006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00cefd0 con 0x7f48b00cead0 2023-11-24T07:57:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00cf2b0 con 0x7f48b015d7b0 2023-11-24T07:57:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48b5cfe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b006b3f0 con 0x7f48b00d2080 2023-11-24T07:57:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48aeffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f48b00cead0 0x7f48b00d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46096/0 (socket says 172.21.15.5:46096) 2023-11-24T07:57:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48af7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48b015d7b0 0x7f48b00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48aeffd640 1 -- 172.21.15.5:0/1987271897 learned_addr learned my addr 172.21.15.5:0/1987271897 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48affff640 1 --2- 172.21.15.5:0/1987271897 >> v2:172.21.15.102:3300/0 conn(0x7f48b00d2080 0x7f48b006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:06.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48ae7fc640 1 -- 172.21.15.5:0/1987271897 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594354992 0 0) 0x7f48b00cefd0 con 0x7f48b00cead0 2023-11-24T07:57:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48ae7fc640 1 -- 172.21.15.5:0/1987271897 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4898003530 con 0x7f48b00cead0 2023-11-24T07:57:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48af7fe640 1 -- 172.21.15.5:0/1987271897 >> v2:172.21.15.102:3300/0 conn(0x7f48b00d2080 msgr2=0x7f48b006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48af7fe640 1 --2- 172.21.15.5:0/1987271897 >> v2:172.21.15.102:3300/0 conn(0x7f48b00d2080 0x7f48b006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48af7fe640 1 -- 172.21.15.5:0/1987271897 >> v1:172.21.15.5:6789/0 conn(0x7f48b00cead0 legacy=0x7f48b00d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.739+0000 7f48af7fe640 1 -- 172.21.15.5:0/1987271897 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b006b6d0 con 0x7f48b015d7b0 2023-11-24T07:57:06.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48af7fe640 1 --2- 172.21.15.5:0/1987271897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b015d7b0 0x7f48b00d10d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f48b008c870 tx=0x7f48a001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d383118935dfd7b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:06.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48ae7fc640 1 -- 172.21.15.5:0/1987271897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00ab600 con 0x7f48b015d7b0 2023-11-24T07:57:06.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48ae7fc640 1 -- 172.21.15.5:0/1987271897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00a7050 con 0x7f48b015d7b0 2023-11-24T07:57:06.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48ae7fc640 1 -- 172.21.15.5:0/1987271897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00ab980 con 0x7f48b015d7b0 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 -- 172.21.15.5:0/1987271897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b015d7b0 msgr2=0x7f48b00d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/1987271897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b015d7b0 0x7f48b00d10d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f48b008c870 tx=0x7f48a001c310 comp rx=0 tx=0).stop 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 -- 172.21.15.5:0/1987271897 shutdown_connections 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/1987271897 >> v2:172.21.15.102:3300/0 conn(0x7f48b00d2080 0x7f48b006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/1987271897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b015d7b0 0x7f48b00d10d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 -- 172.21.15.5:0/1987271897 >> 172.21.15.5:0/1987271897 conn(0x7f48b00d33b0 msgr2=0x7f48b00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 -- 172.21.15.5:0/1987271897 shutdown_connections 2023-11-24T07:57:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.743+0000 7f48b5cfe640 1 -- 172.21.15.5:0/1987271897 wait complete. 2023-11-24T07:57:06.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 Processor -- start 2023-11-24T07:57:06.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- start start 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48b00d2080 0x7f48b00c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 0x7f48b015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c8d30 con 0x7f48b00cead0 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c8120 con 0x7f48b015d7b0 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c8390 con 0x7f48b00d2080 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57740/0 (socket says 172.21.15.5:57740) 2023-11-24T07:57:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 -- 172.21.15.5:0/3624394175 learned_addr learned my addr 172.21.15.5:0/3624394175 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 -- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48b00d2080 msgr2=0x7f48b00c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48b00d2080 0x7f48b00c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 -- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 msgr2=0x7f48b015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48affff640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 0x7f48b015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 0x7f48b015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 -- 172.21.15.5:0/3624394175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009420 con 0x7f48b00cead0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48affff640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 0x7f48b015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48af7fe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ae040 tx=0x7f48a00190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00b4410 con 0x7f48b00cead0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00b4570 con 0x7f48b00cead0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00b4920 con 0x7f48b00cead0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00c8670 con 0x7f48b00cead0 2023-11-24T07:57:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.747+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00cb8e0 con 0x7f48b00cead0 2023-11-24T07:57:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00c8e70 con 0x7f48b00cead0 2023-11-24T07:57:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48a00b2040 con 0x7f48b00cead0 2023-11-24T07:57:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f4897fff640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 0x7f489c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48a011def0 con 0x7f48b00cead0 2023-11-24T07:57:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f48aeffd640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 0x7f489c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.751+0000 7f48aeffd640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 0x7f489c068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a4007fd0 tx=0x7f48a4007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.755+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48a00eb360 con 0x7f48b00cead0 2023-11-24T07:57:06.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48b00cbad0 con 0x7f48b00cead0 2023-11-24T07:57:06.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f4897fff640 1 -- 172.21.15.5:0/3624394175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f48a00c1060 con 0x7f48b00cead0 2023-11-24T07:57:06.950 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:06.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 msgr2=0x7f489c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 0x7f489c068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a4007fd0 tx=0x7f48a4007940 comp rx=0 tx=0).stop 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 msgr2=0x7f48b00cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ae040 tx=0x7f48a00190b0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 shutdown_connections 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f489c066470 0x7f489c068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b015d7b0 0x7f48b015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48b00d2080 0x7f48b00c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 --2- 172.21.15.5:0/3624394175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b00cead0 0x7f48b00cb3a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 >> 172.21.15.5:0/3624394175 conn(0x7f48b00d33b0 msgr2=0x7f48b00b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 shutdown_connections 2023-11-24T07:57:06.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:06.947+0000 7f48b5cfe640 1 -- 172.21.15.5:0/3624394175 wait complete. 2023-11-24T07:57:06.970 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T07:57:06.970 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:06.971 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T07:57:06.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.972 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-11-24T07:57:06.981 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:06.981 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-11-24T07:57:06.982 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:06.983 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.983 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-11-24T07:57:06.983 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:06.983 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.983 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-11-24T07:57:06.984 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T07:57:06.984 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-11-24T07:57:06.985 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-11-24T07:57:06.985 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.985 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:06.985 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:be:f5:01:bf brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:06.986 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-24T07:57:06.987 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:06.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:06.989 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:07.051 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-11-24T07:57:07.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.053 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-11-24T07:57:07.106 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:07.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.107 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:07.107 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:07.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T07:57:07.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T07:57:07.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T07:57:07.108 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:07.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.205 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:57:07.214 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T07:57:07.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.216 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-11-24T07:57:07.268 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T07:57:07.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.270 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:07.270 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:07.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T07:57:07.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T07:57:07.271 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:07.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T07:57:07.418 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether fe:89:f8:e6:52:a9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.419 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fc89:f8ff:fee6:52a9/64 scope link tentative 2023-11-24T07:57:07.420 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T07:57:07.485 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether fe:89:f8:e6:52:a9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.486 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fc89:f8ff:fee6:52a9/64 scope link tentative 2023-11-24T07:57:07.487 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:07.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T07:57:07.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.488 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:07.488 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:07.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T07:57:07.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T07:57:07.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T07:57:07.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T07:57:07.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T07:57:07.489 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:07.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.628 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:07.628 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:07.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2023-11-24T07:57:07.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T07:57:07.629 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:07.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:07.670 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T07:57:07.721 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T07:57:07.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:07.721 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T07:57:07.772 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:07.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T07:57:07.868 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T07:57:07.868 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T07:57:07.868 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:07.883 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T07:57:07.883 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T07:57:07.883 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:07.884 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:07.884 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:07.893 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T07:57:07.893 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T07:57:07.893 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:07.898 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:07.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T07:57:07.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:07.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:07.976 INFO:teuthology.orchestra.run.smithi005.stdout:client4686 2023-11-24T07:57:07.976 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:07.976 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:08.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.030 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:08.083 INFO:teuthology.orchestra.run.smithi005.stdout:client4686 2023-11-24T07:57:08.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.084 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:08.135 INFO:teuthology.orchestra.run.smithi005.stdout:client4686 2023-11-24T07:57:08.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.136 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1c5da79-7f10-46d9-a2ce-04e64f4e6baf.client4686/status') 2023-11-24T07:57:08.201 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4686 (3)192.168.0.2:0/3043785350 2023-11-24T07:57:08.201 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-11-24T07:57:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-11-24T07:57:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-11-24T07:57:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 5.3774e-05 s, 1.3 MB/s 2023-11-24T07:57:08.203 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-24T07:57:08.203 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T07:57:08.203 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:08.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:08.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 Processor -- start 2023-11-24T07:57:08.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 -- start start 2023-11-24T07:57:08.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 0x7fca6c0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c070c20 0x7fca6c15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c145060 con 0x7fca6c070c20 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c071fd0 con 0x7fca6c0ac460 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca721ec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0ac8c0 con 0x7fca6c144c80 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c070c20 0x7fca6c15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c070c20 0x7fca6c15eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60982/0 (socket says 172.21.15.5:60982) 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 -- 172.21.15.5:0/3010768051 learned_addr learned my addr 172.21.15.5:0/3010768051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6b7fe640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca63fff640 1 --2- 172.21.15.5:0/3010768051 >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 0x7fca6c0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 -- 172.21.15.5:0/3010768051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 msgr2=0x7fca6c0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c0abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 -- 172.21.15.5:0/3010768051 >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 msgr2=0x7fca6c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 --2- 172.21.15.5:0/3010768051 >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 0x7fca6c0706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca6bfff640 1 -- 172.21.15.5:0/3010768051 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c071450 con 0x7fca6c070c20 2023-11-24T07:57:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.383+0000 7fca63fff640 1 --2- 172.21.15.5:0/3010768051 >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 0x7fca6c0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca6bfff640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c070c20 0x7fca6c15eed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06bf70 tx=0x7fca6401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e03de8ec80234d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca6affd640 1 -- 172.21.15.5:0/3010768051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640a5560 con 0x7fca6c070c20 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca6affd640 1 -- 172.21.15.5:0/3010768051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640a56c0 con 0x7fca6c070c20 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca6affd640 1 -- 172.21.15.5:0/3010768051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640a5a50 con 0x7fca6c070c20 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 -- 172.21.15.5:0/3010768051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c070c20 msgr2=0x7fca6c15eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c070c20 0x7fca6c15eed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06bf70 tx=0x7fca6401c6e0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 -- 172.21.15.5:0/3010768051 shutdown_connections 2023-11-24T07:57:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c070c20 0x7fca6c15eed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 --2- 172.21.15.5:0/3010768051 >> v2:172.21.15.102:3300/0 conn(0x7fca6c0ac460 0x7fca6c0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 --2- 172.21.15.5:0/3010768051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c0abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 -- 172.21.15.5:0/3010768051 >> 172.21.15.5:0/3010768051 conn(0x7fca6c0b0c40 msgr2=0x7fca6c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 -- 172.21.15.5:0/3010768051 shutdown_connections 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.387+0000 7fca721ec640 1 -- 172.21.15.5:0/3010768051 wait complete. 2023-11-24T07:57:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 Processor -- start 2023-11-24T07:57:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- start start 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6c070c20 0x7fca6c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c13a220 con 0x7fca6c0ac460 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c158aa0 con 0x7fca6c070c20 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c09b8b0 con 0x7fca6c144c80 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca6b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6c070c20 0x7fca6c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60986/0 (socket says 172.21.15.5:60986) 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca6bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 -- 172.21.15.5:0/2771800840 learned_addr learned my addr 172.21.15.5:0/2771800840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 -- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 msgr2=0x7fca6c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 -- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6c070c20 msgr2=0x7fca6c15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6c070c20 0x7fca6c15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 -- 172.21.15.5:0/2771800840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009b30 con 0x7fca6c0ac460 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca63fff640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca5400c7f0 tx=0x7fca5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400cea0 con 0x7fca6c0ac460 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca54007a30 con 0x7fca6c0ac460 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54007dc0 con 0x7fca6c0ac460 2023-11-24T07:57:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c15c900 con 0x7fca6c0ac460 2023-11-24T07:57:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.391+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c158fd0 con 0x7fca6c0ac460 2023-11-24T07:57:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.395+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c0b1ba0 con 0x7fca6c0ac460 2023-11-24T07:57:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.395+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca540113f0 con 0x7fca6c0ac460 2023-11-24T07:57:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.395+0000 7fca68ff9640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 0x7fca4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.395+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca54083f80 con 0x7fca6c0ac460 2023-11-24T07:57:08.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.395+0000 7fca6b7fe640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 0x7fca4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.399+0000 7fca6b7fe640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 0x7fca4c068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0079c0 tx=0x7fca5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.399+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca54051410 con 0x7fca6c0ac460 2023-11-24T07:57:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.591+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca6c0ace20 con 0x7fca6c0ac460 2023-11-24T07:57:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.591+0000 7fca68ff9640 1 -- 172.21.15.5:0/2771800840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca54054a30 con 0x7fca6c0ac460 2023-11-24T07:57:08.595 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 msgr2=0x7fca4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 0x7fca4c068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0079c0 tx=0x7fca5c008040 comp rx=0 tx=0).stop 2023-11-24T07:57:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 msgr2=0x7fca6c09b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca5400c7f0 tx=0x7fca5400ccb0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 shutdown_connections 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca4c066470 0x7fca4c068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca6c144c80 0x7fca6c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c0ac460 0x7fca6c09b370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 --2- 172.21.15.5:0/2771800840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6c070c20 0x7fca6c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 >> 172.21.15.5:0/2771800840 conn(0x7fca6c0b0c40 msgr2=0x7fca6c06cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 shutdown_connections 2023-11-24T07:57:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:08.595+0000 7fca721ec640 1 -- 172.21.15.5:0/2771800840 wait complete. 2023-11-24T07:57:08.616 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T07:57:08.616 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:08.616 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-24T07:57:08.616 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T07:57:08.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:08.617 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T07:57:08.617 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T07:57:08.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:08.617 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T07:57:08.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.617 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-24T07:57:08.629 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:08.629 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-24T07:57:08.630 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:c2:a0:4d:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:08.631 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:08.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T07:57:08.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T07:57:08.632 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:08.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.746 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:08.765 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-24T07:57:08.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.767 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-24T07:57:08.834 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:08.835 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:08.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T07:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:08.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.926 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:57:08.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.936 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-11-24T07:57:08.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:08.993 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:08.993 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:08.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T07:57:08.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T07:57:08.993 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:09.077 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T07:57:09.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T07:57:09.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T07:57:09.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T07:57:09.078 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:09.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.242 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:09.242 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:09.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-11-24T07:57:09.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T07:57:09.243 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:09.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:09.284 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:09.340 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T07:57:09.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:09.340 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:09.395 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:09.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.395 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:09.495 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:09.495 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:09.495 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:09.609 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:09.610 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:09.610 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:09.610 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:09.610 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:09.621 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:09.621 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:09.621 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:09.621 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:09.621 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:09.622 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:09.622 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:09.622 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:09.625 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:09.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:09.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.645 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:09.704 INFO:teuthology.orchestra.run.smithi102.stdout:client4520 2023-11-24T07:57:09.704 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:09.704 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:09.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.756 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:09.810 INFO:teuthology.orchestra.run.smithi102.stdout:client4520 2023-11-24T07:57:09.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.811 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:09.862 INFO:teuthology.orchestra.run.smithi102.stdout:client4520 2023-11-24T07:57:09.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:09.863 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1c5da79-7f10-46d9-a2ce-04e64f4e6baf.client4520/status') 2023-11-24T07:57:09.923 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4520 (3)192.168.0.1:0/1587208614 2023-11-24T07:57:09.923 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2023-11-24T07:57:09.923 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2023-11-24T07:57:09.924 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2023-11-24T07:57:09.924 INFO:teuthology.orchestra.run.smithi102.stderr:69 bytes copied, 4.959e-05 s, 1.4 MB/s 2023-11-24T07:57:09.925 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-24T07:57:09.925 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T07:57:09.925 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T07:57:09.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.075+0000 7f414b501640 1 Processor -- start 2023-11-24T07:57:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 -- start start 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f414415d7b0 0x7f41440d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41440d2080 0x7f414406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440cefd0 con 0x7f41440cead0 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41440cf2b0 con 0x7f41440d2080 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414b501640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414406b3f0 con 0x7f414415d7b0 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4149a9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41440d2080 0x7f414406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4148a9c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41440cead0 0x7f41440d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58336/0 (socket says 172.21.15.5:58336) 2023-11-24T07:57:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f414929d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f414415d7b0 0x7f41440d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4148a9c640 1 -- 172.21.15.5:0/111063359 learned_addr learned my addr 172.21.15.5:0/111063359 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4149a9e640 1 -- 172.21.15.5:0/111063359 >> v2:172.21.15.102:3300/0 conn(0x7f414415d7b0 msgr2=0x7f41440d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4149a9e640 1 --2- 172.21.15.5:0/111063359 >> v2:172.21.15.102:3300/0 conn(0x7f414415d7b0 0x7f41440d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4149a9e640 1 -- 172.21.15.5:0/111063359 >> v1:172.21.15.5:6789/0 conn(0x7f41440cead0 legacy=0x7f41440d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.079+0000 7f4149a9e640 1 -- 172.21.15.5:0/111063359 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414406b6d0 con 0x7f41440d2080 2023-11-24T07:57:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f4149a9e640 1 --2- 172.21.15.5:0/111063359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440d2080 0x7f414406bed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41440d3310 tx=0x7f413c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f654d47c1d44aea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f413bfff640 1 -- 172.21.15.5:0/111063359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a58a0 con 0x7f41440d2080 2023-11-24T07:57:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f413bfff640 1 -- 172.21.15.5:0/111063359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0a5a00 con 0x7f41440d2080 2023-11-24T07:57:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f413bfff640 1 -- 172.21.15.5:0/111063359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a5d90 con 0x7f41440d2080 2023-11-24T07:57:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- 172.21.15.5:0/111063359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440d2080 msgr2=0x7f414406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 --2- 172.21.15.5:0/111063359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440d2080 0x7f414406bed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41440d3310 tx=0x7f413c01c7c0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- 172.21.15.5:0/111063359 shutdown_connections 2023-11-24T07:57:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 --2- 172.21.15.5:0/111063359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440d2080 0x7f414406bed0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 --2- 172.21.15.5:0/111063359 >> v2:172.21.15.102:3300/0 conn(0x7f414415d7b0 0x7f41440d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- 172.21.15.5:0/111063359 >> 172.21.15.5:0/111063359 conn(0x7f41440d33b0 msgr2=0x7f41440d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- 172.21.15.5:0/111063359 shutdown_connections 2023-11-24T07:57:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- 172.21.15.5:0/111063359 wait complete. 2023-11-24T07:57:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 Processor -- start 2023-11-24T07:57:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.083+0000 7f414b501640 1 -- start start 2023-11-24T07:57:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41440d2080 0x7f41440b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f414415d7b0 0x7f41440c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144158810 con 0x7f41440cead0 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144158af0 con 0x7f41440d2080 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4144158dd0 con 0x7f414415d7b0 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32786/0 (socket says 172.21.15.5:32786) 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 -- 172.21.15.5:0/871131728 learned_addr learned my addr 172.21.15.5:0/871131728 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f4149a9e640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f414415d7b0 0x7f41440c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f4148a9c640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41440d2080 0x7f41440b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 -- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f414415d7b0 msgr2=0x7f41440c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f414415d7b0 0x7f41440c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 -- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41440d2080 msgr2=0x7f41440b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41440d2080 0x7f41440b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 -- 172.21.15.5:0/871131728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009a70 con 0x7f41440cead0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414929d640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f414000e870 tx=0x7f414000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140009510 con 0x7f41440cead0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414000eec0 con 0x7f41440cead0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000cb40 con 0x7f41440cead0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441590b0 con 0x7f41440cead0 2023-11-24T07:57:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440cb190 con 0x7f41440cead0 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.087+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414404e850 con 0x7f41440cead0 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.091+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f414000cca0 con 0x7f41440cead0 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.091+0000 7f4139ffb640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 0x7f4128068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.091+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4140083f10 con 0x7f41440cead0 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.091+0000 7f4148a9c640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 0x7f4128068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:10.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.091+0000 7f4148a9c640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 0x7f4128068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4144158330 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:10.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.095+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4140051430 con 0x7f41440cead0 2023-11-24T07:57:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.287+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41440ca000 con 0x7f41440cead0 2023-11-24T07:57:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.287+0000 7f4139ffb640 1 -- 172.21.15.5:0/871131728 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4140054a50 con 0x7f41440cead0 2023-11-24T07:57:10.291 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.287+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 msgr2=0x7f4128068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.287+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 0x7f4128068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4144158330 tx=0x7f4134009040 comp rx=0 tx=0).stop 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 msgr2=0x7f41440cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f414000e870 tx=0x7f414000ec70 comp rx=0 tx=0).stop 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 shutdown_connections 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4128066470 0x7f4128068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f414415d7b0 0x7f41440c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41440d2080 0x7f41440b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 --2- 172.21.15.5:0/871131728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41440cead0 0x7f41440cac50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 >> 172.21.15.5:0/871131728 conn(0x7f41440d33b0 msgr2=0x7f41440d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 shutdown_connections 2023-11-24T07:57:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:10.291+0000 7f414b501640 1 -- 172.21.15.5:0/871131728 wait complete. 2023-11-24T07:57:10.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T07:57:10.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:10.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T07:57:10.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.314 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-24T07:57:10.324 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:10.324 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:10.324 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:10.325 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.325 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:10.325 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.325 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:10.325 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.326 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-24T07:57:10.326 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:10.326 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.326 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-24T07:57:10.326 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:10.327 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.327 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:10.327 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.327 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T07:57:10.327 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-11-24T07:57:10.328 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-24T07:57:10.328 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.328 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:10.329 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:c2:a0:4d:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.329 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:10.329 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.329 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:10.329 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:10.330 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T07:57:10.331 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-24T07:57:10.331 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:10.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.331 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:10.386 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-24T07:57:10.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.389 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-24T07:57:10.444 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-24T07:57:10.751 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:10.751 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:10.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.753 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:10.753 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:10.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T07:57:10.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T07:57:10.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T07:57:10.754 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:10.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.810 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:57:10.820 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T07:57:10.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.821 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-11-24T07:57:10.876 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T07:57:10.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.877 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:10.877 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:10.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T07:57:10.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T07:57:10.877 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:10.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:10.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T07:57:11.024 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0a:06:c3:e5:b8:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::806:c3ff:fee5:b8eb/64 scope link 2023-11-24T07:57:11.025 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T07:57:11.089 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0a:06:c3:e5:b8:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::806:c3ff:fee5:b8eb/64 scope link 2023-11-24T07:57:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:11.091 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T07:57:11.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T07:57:11.092 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:11.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.234 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:11.234 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:11.234 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2023-11-24T07:57:11.234 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T07:57:11.234 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:11.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:11.276 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T07:57:11.328 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T07:57:11.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:11.328 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T07:57:11.383 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:11.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T07:57:11.477 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T07:57:11.477 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T07:57:11.477 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:11.491 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T07:57:11.492 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T07:57:11.492 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:11.492 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:11.492 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:11.500 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:11.501 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:11.505 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:11.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.505 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T07:57:11.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.525 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:11.578 INFO:teuthology.orchestra.run.smithi102.stdout:client4654 2023-11-24T07:57:11.578 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:11.578 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:11.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.628 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:11.686 INFO:teuthology.orchestra.run.smithi102.stdout:client4654 2023-11-24T07:57:11.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.686 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:11.742 INFO:teuthology.orchestra.run.smithi102.stdout:client4654 2023-11-24T07:57:11.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:11.742 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1c5da79-7f10-46d9-a2ce-04e64f4e6baf.client4654/status') 2023-11-24T07:57:11.807 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4654 (3)192.168.0.2:0/749225634 2023-11-24T07:57:11.807 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2023-11-24T07:57:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2023-11-24T07:57:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2023-11-24T07:57:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:68 bytes copied, 4.9203e-05 s, 1.4 MB/s 2023-11-24T07:57:11.809 INFO:teuthology.run_tasks:Running task check-counter... 2023-11-24T07:57:11.842 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T07:57:11.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:12.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.007+0000 7fa5f7ad6640 1 Processor -- start 2023-11-24T07:57:12.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.007+0000 7fa5f7ad6640 1 -- start start 2023-11-24T07:57:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f7ad6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 0x7fa5f00b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f7ad6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5f00cecd0 0x7fa5f006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f7ad6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00b0a70 con 0x7fa5f00b5120 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f7ad6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00cddb0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f7ad6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00b4100 con 0x7fa5f015d8b0 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5f00cecd0 0x7fa5f006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5f00cecd0 0x7fa5f006a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32800/0 (socket says 172.21.15.5:32800) 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 -- 172.21.15.5:0/1836374559 learned_addr learned my addr 172.21.15.5:0/1836374559 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f5872640 1 --2- 172.21.15.5:0/1836374559 >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 0x7fa5f00b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 -- 172.21.15.5:0/1836374559 >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 msgr2=0x7fa5f00b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 --2- 172.21.15.5:0/1836374559 >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 0x7fa5f00b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 -- 172.21.15.5:0/1836374559 >> v1:172.21.15.102:6789/0 conn(0x7fa5f00b5120 legacy=0x7fa5f00ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f6073640 1 -- 172.21.15.5:0/1836374559 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00b43e0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.011+0000 7fa5f5872640 1 --2- 172.21.15.5:0/1836374559 >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 0x7fa5f00b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f6073640 1 --2- 172.21.15.5:0/1836374559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f006a5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0073ee0 tx=0x7fa5e801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa64b919ebd9a27e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f4870640 1 -- 172.21.15.5:0/1836374559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80af400 con 0x7fa5f00cecd0 2023-11-24T07:57:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f4870640 1 -- 172.21.15.5:0/1836374559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e80ab050 con 0x7fa5f00cecd0 2023-11-24T07:57:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f4870640 1 -- 172.21.15.5:0/1836374559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80af780 con 0x7fa5f00cecd0 2023-11-24T07:57:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1836374559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 msgr2=0x7fa5f006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1836374559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f006a5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0073ee0 tx=0x7fa5e801f1c0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1836374559 shutdown_connections 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1836374559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f006a5b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1836374559 >> v2:172.21.15.102:3300/0 conn(0x7fa5f015d8b0 0x7fa5f00b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1836374559 >> 172.21.15.5:0/1836374559 conn(0x7fa5f00b5570 msgr2=0x7fa5f00b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1836374559 shutdown_connections 2023-11-24T07:57:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1836374559 wait complete. 2023-11-24T07:57:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 Processor -- start 2023-11-24T07:57:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- start start 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f00b5120 0x7fa5f00cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f015d8b0 0x7fa5f01f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.015+0000 7fa5f7ad6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00caca0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f7ad6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cb0c0 con 0x7fa5f015d8b0 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f7ad6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c9700 con 0x7fa5f00b5120 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32816/0 (socket says 172.21.15.5:32816) 2023-11-24T07:57:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 -- 172.21.15.5:0/1649060926 learned_addr learned my addr 172.21.15.5:0/1649060926 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f6073640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f015d8b0 0x7fa5f01f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5872640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f00b5120 0x7fa5f00cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 -- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f00b5120 msgr2=0x7fa5f00cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f00b5120 0x7fa5f00cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 -- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f015d8b0 msgr2=0x7fa5f01f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f015d8b0 0x7fa5f01f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 -- 172.21.15.5:0/1649060926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009b30 con 0x7fa5f00cecd0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f5071640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000c500 tx=0x7fa5e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00052d0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0005430 con 0x7fa5f00cecd0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0012830 con 0x7fa5f00cecd0 2023-11-24T07:57:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00ca020 con 0x7fa5f00cecd0 2023-11-24T07:57:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00ca5e0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00cade0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5e0012990 con 0x7fa5f00cecd0 2023-11-24T07:57:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.019+0000 7fa5e67fc640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 0x7fa5d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.023+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5e00838f0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.023+0000 7fa5f5872640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 0x7fa5d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.023+0000 7fa5f5872640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 0x7fa5d4068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec006e90 tx=0x7fa5ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.027+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5e0050d90 con 0x7fa5f00cecd0 2023-11-24T07:57:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.183+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5f004e850 con 0x7fa5f00cecd0 2023-11-24T07:57:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.183+0000 7fa5e67fc640 1 -- 172.21.15.5:0/1649060926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fa5e00543b0 con 0x7fa5f00cecd0 2023-11-24T07:57:12.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:12.188 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 msgr2=0x7fa5d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 0x7fa5d4068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec006e90 tx=0x7fa5ec008040 comp rx=0 tx=0).stop 2023-11-24T07:57:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 msgr2=0x7fa5f00cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000c500 tx=0x7fa5e000c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 shutdown_connections 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5d40664a0 0x7fa5d4068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f015d8b0 0x7fa5f01f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f00cecd0 0x7fa5f00cbd50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 --2- 172.21.15.5:0/1649060926 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f00b5120 0x7fa5f00cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 >> 172.21.15.5:0/1649060926 conn(0x7fa5f00b5570 msgr2=0x7fa5f00b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 shutdown_connections 2023-11-24T07:57:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.187+0000 7fa5f7ad6640 1 -- 172.21.15.5:0/1649060926 wait complete. 2023-11-24T07:57:12.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:12.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 Processor -- start 2023-11-24T07:57:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 -- start start 2023-11-24T07:57:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 0x7f20f01619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f0161290 con 0x7f20f00b2870 2023-11-24T07:57:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00b0b80 con 0x7f20f00b07a0 2023-11-24T07:57:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20f5f57640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f015ebc0 con 0x7f20f0161f20 2023-11-24T07:57:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20ef7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 0x7f20f01619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:44386/0 (socket says 172.21.15.5:44386) 2023-11-24T07:57:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 -- 172.21.15.5:0/2016466109 learned_addr learned my addr 172.21.15.5:0/2016466109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20effff640 1 --1- 172.21.15.5:0/2016466109 >> v1:172.21.15.102:6789/0 conn(0x7f20f00b2870 0x7f20f00cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39204/0 (socket says 172.21.15.5:39204) 2023-11-24T07:57:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20ee7fc640 1 -- 172.21.15.5:0/2016466109 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714158085 0 0) 0x7f20f0161290 con 0x7f20f00b2870 2023-11-24T07:57:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 -- 172.21.15.5:0/2016466109 >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 msgr2=0x7f20f01619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 --2- 172.21.15.5:0/2016466109 >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 0x7f20f01619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 -- 172.21.15.5:0/2016466109 >> v1:172.21.15.102:6789/0 conn(0x7f20f00b2870 legacy=0x7f20f00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20eeffd640 1 -- 172.21.15.5:0/2016466109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0161550 con 0x7f20f0161f20 2023-11-24T07:57:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.355+0000 7f20ef7fe640 1 --2- 172.21.15.5:0/2016466109 >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 0x7f20f01619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20eeffd640 1 --2- 172.21.15.5:0/2016466109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d65736a4963f0a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20ee7fc640 1 -- 172.21.15.5:0/2016466109 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40a7070 con 0x7f20f0161f20 2023-11-24T07:57:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20ee7fc640 1 -- 172.21.15.5:0/2016466109 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40ab430 con 0x7f20f0161f20 2023-11-24T07:57:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20ee7fc640 1 -- 172.21.15.5:0/2016466109 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40ab7c0 con 0x7f20f0161f20 2023-11-24T07:57:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 -- 172.21.15.5:0/2016466109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 msgr2=0x7f20f00b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 --2- 172.21.15.5:0/2016466109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c540 comp rx=0 tx=0).stop 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 -- 172.21.15.5:0/2016466109 shutdown_connections 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 --2- 172.21.15.5:0/2016466109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f0161f20 0x7f20f00b0ee0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 --2- 172.21.15.5:0/2016466109 >> v2:172.21.15.102:3300/0 conn(0x7f20f00b07a0 0x7f20f01619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 -- 172.21.15.5:0/2016466109 >> 172.21.15.5:0/2016466109 conn(0x7f20f00b1d50 msgr2=0x7f20f00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 -- 172.21.15.5:0/2016466109 shutdown_connections 2023-11-24T07:57:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.359+0000 7f20f5f57640 1 -- 172.21.15.5:0/2016466109 wait complete. 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 Processor -- start 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- start start 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f00b07a0 0x7f20f014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20f0161f20 0x7f20f00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b5b80 con 0x7f20f00b2870 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f014e370 con 0x7f20f0161f20 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b4f70 con 0x7f20f00b07a0 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32818/0 (socket says 172.21.15.5:32818) 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 -- 172.21.15.5:0/1448802964 learned_addr learned my addr 172.21.15.5:0/1448802964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20ef7fe640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f00b07a0 0x7f20f014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20effff640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20f0161f20 0x7f20f00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 -- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f00b07a0 msgr2=0x7f20f014de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f00b07a0 0x7f20f014de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 -- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20f0161f20 msgr2=0x7f20f00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20f0161f20 0x7f20f00ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 -- 172.21.15.5:0/1448802964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009420 con 0x7f20f00b2870 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20eeffd640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20e401a170 tx=0x7f20e40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40ba070 con 0x7f20f00b2870 2023-11-24T07:57:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40b4420 con 0x7f20f00b2870 2023-11-24T07:57:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e40094d0 con 0x7f20f00b2870 2023-11-24T07:57:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40b47b0 con 0x7f20f00b2870 2023-11-24T07:57:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.363+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00b5530 con 0x7f20f00b2870 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f004e850 con 0x7f20f00b2870 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20e40b4910 con 0x7f20f00b2870 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20d7fff640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 0x7f20dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20e411d6f0 con 0x7f20f00b2870 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20ef7fe640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 0x7f20dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.367+0000 7f20ef7fe640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 0x7f20dc068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20f0151fa0 tx=0x7f20e0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.371+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20e40eab80 con 0x7f20f00b2870 2023-11-24T07:57:12.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20f00cce90 con 0x7f20f00b2870 2023-11-24T07:57:12.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20d7fff640 1 -- 172.21.15.5:0/1448802964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20e40ee1a0 con 0x7f20f00b2870 2023-11-24T07:57:12.534 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 msgr2=0x7f20dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 0x7f20dc068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20f0151fa0 tx=0x7f20e0009190 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 msgr2=0x7f20f00cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20e401a170 tx=0x7f20e40192e0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 shutdown_connections 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f20dc0664a0 0x7f20dc068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20f0161f20 0x7f20f00ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f00b2870 0x7f20f00cdcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 --2- 172.21.15.5:0/1448802964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f20f00b07a0 0x7f20f014de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 >> 172.21.15.5:0/1448802964 conn(0x7f20f00b1d50 msgr2=0x7f20f006a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 shutdown_connections 2023-11-24T07:57:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.531+0000 7f20f5f57640 1 -- 172.21.15.5:0/1448802964 wait complete. 2023-11-24T07:57:12.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 Processor -- start 2023-11-24T07:57:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 -- start start 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c8159f00 0x7fc3c80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3c80ae680 0x7fc3c80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c8072950 con 0x7fc3c80cd920 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c806e2b0 con 0x7fc3c80ae680 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3ce9aa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c806c6f0 con 0x7fc3c8159f00 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3c80ae680 0x7fc3c80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3c80ae680 0x7fc3c80cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32832/0 (socket says 172.21.15.5:32832) 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 -- 172.21.15.5:0/1578775133 learned_addr learned my addr 172.21.15.5:0/1578775133 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c7fff640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c8159f00 0x7fc3c80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 -- 172.21.15.5:0/1578775133 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c8159f00 msgr2=0x7fc3c80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c8159f00 0x7fc3c80ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 -- 172.21.15.5:0/1578775133 >> v1:172.21.15.5:6789/0 conn(0x7fc3c80cd920 legacy=0x7fc3c815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c77fe640 1 -- 172.21.15.5:0/1578775133 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c806e550 con 0x7fc3c80ae680 2023-11-24T07:57:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.699+0000 7fc3c6ffd640 1 -- 172.21.15.5:0/1578775133 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320551444 0 0) 0x7fc3c8072950 con 0x7fc3c80cd920 2023-11-24T07:57:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3c77fe640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c80cd3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00bb10 tx=0x7fc3bc01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fff2a06d2462aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3c6ffd640 1 -- 172.21.15.5:0/1578775133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0a7b50 con 0x7fc3c80ae680 2023-11-24T07:57:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3c6ffd640 1 -- 172.21.15.5:0/1578775133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0a7cb0 con 0x7fc3c80ae680 2023-11-24T07:57:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3c6ffd640 1 -- 172.21.15.5:0/1578775133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0af660 con 0x7fc3c80ae680 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1578775133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 msgr2=0x7fc3c80cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c80cd3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00bb10 tx=0x7fc3bc01ec10 comp rx=0 tx=0).stop 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1578775133 shutdown_connections 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c80cd3e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1578775133 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c8159f00 0x7fc3c80ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1578775133 >> 172.21.15.5:0/1578775133 conn(0x7fc3c80b0cb0 msgr2=0x7fc3c80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1578775133 shutdown_connections 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1578775133 wait complete. 2023-11-24T07:57:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.703+0000 7fc3ce9aa640 1 Processor -- start 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- start start 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c80cd920 0x7fc3c815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3c815cf20 0x7fc3c8070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c809c720 con 0x7fc3c80ae680 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c81529a0 con 0x7fc3c815cf20 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8152c60 con 0x7fc3c80cd920 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32842/0 (socket says 172.21.15.5:32842) 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 -- 172.21.15.5:0/1095945746 learned_addr learned my addr 172.21.15.5:0/1095945746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c77fe640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c80cd920 0x7fc3c815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ccf47640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3c815cf20 0x7fc3c8070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 -- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c80cd920 msgr2=0x7fc3c815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c80cd920 0x7fc3c815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 -- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3c815cf20 msgr2=0x7fc3c8070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3c815cf20 0x7fc3c8070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 -- 172.21.15.5:0/1095945746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc00b770 con 0x7fc3c80ae680 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c7fff640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800d5f0 tx=0x7fc3b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80125f0 con 0x7fc3c80ae680 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8012750 con 0x7fc3c80ae680 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8152f40 con 0x7fc3c80ae680 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012ae0 con 0x7fc3c80ae680 2023-11-24T07:57:12.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c8153500 con 0x7fc3c80ae680 2023-11-24T07:57:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.707+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c80671f0 con 0x7fc3c80ae680 2023-11-24T07:57:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.711+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3b8012c40 con 0x7fc3c80ae680 2023-11-24T07:57:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.711+0000 7fc3c4ff9640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 0x7fc3b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.711+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b80842b0 con 0x7fc3c80ae680 2023-11-24T07:57:12.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.711+0000 7fc3c77fe640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 0x7fc3b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:12.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.711+0000 7fc3c77fe640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 0x7fc3b4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0b1000 tx=0x7fc3bc0a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:12.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.715+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3b8051740 con 0x7fc3c80ae680 2023-11-24T07:57:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.899+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3c806b460 con 0x7fc3c80ae680 2023-11-24T07:57:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3c4ff9640 1 -- 172.21.15.5:0/1095945746 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b8007380 con 0x7fc3c80ae680 2023-11-24T07:57:12.905 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 msgr2=0x7fc3b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 0x7fc3b4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0b1000 tx=0x7fc3bc0a9070 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 msgr2=0x7fc3c8152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800d5f0 tx=0x7fc3b800dab0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 shutdown_connections 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc3b4066470 0x7fc3b4068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3c815cf20 0x7fc3c8070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc3c80cd920 0x7fc3c815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 --2- 172.21.15.5:0/1095945746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3c80ae680 0x7fc3c8152460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 >> 172.21.15.5:0/1095945746 conn(0x7fc3c80b0cb0 msgr2=0x7fc3c8155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 shutdown_connections 2023-11-24T07:57:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:12.903+0000 7fc3ce9aa640 1 -- 172.21.15.5:0/1095945746 wait complete. 2023-11-24T07:57:12.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 Processor -- start 2023-11-24T07:57:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 -- start start 2023-11-24T07:57:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4ccc146820 0x7f4ccc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc147190 con 0x7f4ccc15eb50 2023-11-24T07:57:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc06d030 con 0x7f4ccc0b4210 2023-11-24T07:57:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd29df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ccc161fa0 con 0x7f4ccc146820 2023-11-24T07:57:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd0f7c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ccc15eb50 0x7f4ccc161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58348/0 (socket says 172.21.15.5:58348) 2023-11-24T07:57:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4cd0f7c640 1 -- 172.21.15.5:0/3351788617 learned_addr learned my addr 172.21.15.5:0/3351788617 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccbfff640 1 --2- 172.21.15.5:0/3351788617 >> v2:172.21.15.102:3300/0 conn(0x7f4ccc146820 0x7f4ccc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344077373 0 0) 0x7f4ccc147190 con 0x7f4ccc15eb50 2023-11-24T07:57:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cb4003530 con 0x7f4ccc15eb50 2023-11-24T07:57:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccbfff640 1 -- 172.21.15.5:0/3351788617 >> v1:172.21.15.102:6789/0 conn(0x7f4ccc0b4210 legacy=0x7f4ccc161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccbfff640 1 -- 172.21.15.5:0/3351788617 >> v1:172.21.15.5:6789/0 conn(0x7f4ccc15eb50 legacy=0x7f4ccc161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056396355 0 0) 0x7f4ccc06d030 con 0x7f4ccc0b4210 2023-11-24T07:57:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.071+0000 7f4ccbfff640 1 -- 172.21.15.5:0/3351788617 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc146c00 con 0x7f4ccc146820 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4ccbfff640 1 --2- 172.21.15.5:0/3351788617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc146820 0x7f4ccc070a50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc146df0 tx=0x7f4cbc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b38f16c8200ac70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0ab650 con 0x7f4ccc146820 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc0ab7b0 con 0x7f4ccc146820 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4ccaffd640 1 -- 172.21.15.5:0/3351788617 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0abb40 con 0x7f4ccc146820 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 -- 172.21.15.5:0/3351788617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc146820 msgr2=0x7f4ccc070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 --2- 172.21.15.5:0/3351788617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc146820 0x7f4ccc070a50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc146df0 tx=0x7f4cbc01c450 comp rx=0 tx=0).stop 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 -- 172.21.15.5:0/3351788617 shutdown_connections 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 --2- 172.21.15.5:0/3351788617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc146820 0x7f4ccc070a50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 -- 172.21.15.5:0/3351788617 >> 172.21.15.5:0/3351788617 conn(0x7f4ccc0b2f10 msgr2=0x7f4ccc0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 -- 172.21.15.5:0/3351788617 shutdown_connections 2023-11-24T07:57:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.075+0000 7f4cd29df640 1 -- 172.21.15.5:0/3351788617 wait complete. 2023-11-24T07:57:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 Processor -- start 2023-11-24T07:57:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 -- start start 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ccc0b4210 0x7f4ccc0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc15eb50 0x7f4ccc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0b1380 con 0x7f4ccc146820 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0b15b0 con 0x7f4ccc15eb50 2023-11-24T07:57:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd29df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0b1890 con 0x7f4ccc0b4210 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4ccb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4ccb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32846/0 (socket says 172.21.15.5:32846) 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4ccb7fe640 1 -- 172.21.15.5:0/1692742547 learned_addr learned my addr 172.21.15.5:0/1692742547 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4cd0f7c640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc15eb50 0x7f4ccc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.079+0000 7f4ccbfff640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ccc0b4210 0x7f4ccc0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 -- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ccc0b4210 msgr2=0x7f4ccc0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ccc0b4210 0x7f4ccc0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 -- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc15eb50 msgr2=0x7f4ccc158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc15eb50 0x7f4ccc158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 -- 172.21.15.5:0/1692742547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc009420 con 0x7f4ccc146820 2023-11-24T07:57:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4ccb7fe640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0001ec0 tx=0x7f4cc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00054e0 con 0x7f4ccc146820 2023-11-24T07:57:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0003600 con 0x7f4ccc146820 2023-11-24T07:57:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc0b1b70 con 0x7f4ccc146820 2023-11-24T07:57:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00039b0 con 0x7f4ccc146820 2023-11-24T07:57:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc0b2130 con 0x7f4ccc146820 2023-11-24T07:57:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc0b2350 con 0x7f4ccc146820 2023-11-24T07:57:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cc0003b10 con 0x7f4ccc146820 2023-11-24T07:57:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 0x7f4cb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.083+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cc00833e0 con 0x7f4ccc146820 2023-11-24T07:57:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.087+0000 7f4ccbfff640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 0x7f4cb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.087+0000 7f4ccbfff640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 0x7f4cb8068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0af000 tx=0x7f4cbc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.087+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cc0050900 con 0x7f4ccc146820 2023-11-24T07:57:13.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.243+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ccc04e850 con 0x7f4ccc146820 2023-11-24T07:57:13.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cc8ff9640 1 -- 172.21.15.5:0/1692742547 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cc00170a0 con 0x7f4ccc146820 2023-11-24T07:57:13.249 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:13.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 msgr2=0x7f4cb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 0x7f4cb8068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0af000 tx=0x7f4cbc0a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 msgr2=0x7f4ccc15ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0001ec0 tx=0x7f4cc000c8e0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 shutdown_connections 2023-11-24T07:57:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4cb8066470 0x7f4cb8068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ccc15eb50 0x7f4ccc158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ccc146820 0x7f4ccc15ae80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 --2- 172.21.15.5:0/1692742547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ccc0b4210 0x7f4ccc0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 >> 172.21.15.5:0/1692742547 conn(0x7f4ccc0b2f10 msgr2=0x7f4ccc13a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 shutdown_connections 2023-11-24T07:57:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.247+0000 7f4cd29df640 1 -- 172.21.15.5:0/1692742547 wait complete. 2023-11-24T07:57:13.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 Processor -- start 2023-11-24T07:57:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 -- start start 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3ba4144c80 0x7f3ba40abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba40ac460 0x7f3ba40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba4145060 con 0x7f3ba4070c20 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba4071fd0 con 0x7f3ba40ac460 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3bab032640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40ac8c0 con 0x7f3ba4144c80 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba40ac460 0x7f3ba40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba95cf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ba4070c20 0x7f3ba415eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58352/0 (socket says 172.21.15.5:58352) 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba95cf640 1 -- 172.21.15.5:0/2778171022 learned_addr learned my addr 172.21.15.5:0/2778171022 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba40ac460 0x7f3ba40706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32848/0 (socket says 172.21.15.5:32848) 2023-11-24T07:57:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba8dce640 1 --2- 172.21.15.5:0/2778171022 >> v2:172.21.15.102:3300/0 conn(0x7f3ba4144c80 0x7f3ba40abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.411+0000 7f3ba37fe640 1 -- 172.21.15.5:0/2778171022 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364043387 0 0) 0x7f3ba4145060 con 0x7f3ba4070c20 2023-11-24T07:57:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba37fe640 1 -- 172.21.15.5:0/2778171022 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b94003530 con 0x7f3ba4070c20 2023-11-24T07:57:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba3fff640 1 -- 172.21.15.5:0/2778171022 >> v2:172.21.15.102:3300/0 conn(0x7f3ba4144c80 msgr2=0x7f3ba40abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba3fff640 1 --2- 172.21.15.5:0/2778171022 >> v2:172.21.15.102:3300/0 conn(0x7f3ba4144c80 0x7f3ba40abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba3fff640 1 -- 172.21.15.5:0/2778171022 >> v1:172.21.15.5:6789/0 conn(0x7f3ba4070c20 legacy=0x7f3ba415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba3fff640 1 -- 172.21.15.5:0/2778171022 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4071450 con 0x7f3ba40ac460 2023-11-24T07:57:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba3fff640 1 --2- 172.21.15.5:0/2778171022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba40ac460 0x7f3ba40706e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406eb80 tx=0x7f3b9001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d196932822d76909 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba37fe640 1 -- 172.21.15.5:0/2778171022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900a7070 con 0x7f3ba40ac460 2023-11-24T07:57:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba37fe640 1 -- 172.21.15.5:0/2778171022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900ab430 con 0x7f3ba40ac460 2023-11-24T07:57:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3ba37fe640 1 -- 172.21.15.5:0/2778171022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900ab7c0 con 0x7f3ba40ac460 2023-11-24T07:57:13.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 -- 172.21.15.5:0/2778171022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba40ac460 msgr2=0x7f3ba40706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 --2- 172.21.15.5:0/2778171022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba40ac460 0x7f3ba40706e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406eb80 tx=0x7f3b9001c430 comp rx=0 tx=0).stop 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 -- 172.21.15.5:0/2778171022 shutdown_connections 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 --2- 172.21.15.5:0/2778171022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba40ac460 0x7f3ba40706e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 --2- 172.21.15.5:0/2778171022 >> v2:172.21.15.102:3300/0 conn(0x7f3ba4144c80 0x7f3ba40abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 -- 172.21.15.5:0/2778171022 >> 172.21.15.5:0/2778171022 conn(0x7f3ba40b0c40 msgr2=0x7f3ba40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 -- 172.21.15.5:0/2778171022 shutdown_connections 2023-11-24T07:57:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.415+0000 7f3bab032640 1 -- 172.21.15.5:0/2778171022 wait complete. 2023-11-24T07:57:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 Processor -- start 2023-11-24T07:57:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 -- start start 2023-11-24T07:57:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ba40ac460 0x7f3ba415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ba4144c80 0x7f3ba409c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba415b320 con 0x7f3ba4070c20 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba415ccc0 con 0x7f3ba4144c80 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3bab032640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba415cfa0 con 0x7f3ba40ac460 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32854/0 (socket says 172.21.15.5:32854) 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 -- 172.21.15.5:0/2365516782 learned_addr learned my addr 172.21.15.5:0/2365516782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba95cf640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ba4144c80 0x7f3ba409c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba3fff640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ba40ac460 0x7f3ba415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 -- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ba40ac460 msgr2=0x7f3ba415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ba40ac460 0x7f3ba415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 -- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ba4144c80 msgr2=0x7f3ba409c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ba4144c80 0x7f3ba409c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 -- 172.21.15.5:0/2365516782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009420 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.419+0000 7f3ba8dce640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800e870 tx=0x7f3b9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98009510 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800eec0 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba415d280 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800cb40 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba415d840 con 0x7f3ba4070c20 2023-11-24T07:57:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba40b1ba0 con 0x7f3ba4070c20 2023-11-24T07:57:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b9800cca0 con 0x7f3ba4070c20 2023-11-24T07:57:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.423+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b98083f20 con 0x7f3ba4070c20 2023-11-24T07:57:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.427+0000 7f3ba3fff640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.427+0000 7f3ba3fff640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 0x7f3b88068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b900af000 tx=0x7f3b900a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.427+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b98051430 con 0x7f3ba4070c20 2023-11-24T07:57:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.587+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba404e850 con 0x7f3ba4070c20 2023-11-24T07:57:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.587+0000 7f3ba17fa640 1 -- 172.21.15.5:0/2365516782 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f3b98054a50 con 0x7f3ba4070c20 2023-11-24T07:57:13.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:13.591 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 msgr2=0x7f3b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 0x7f3b88068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b900af000 tx=0x7f3b900a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 msgr2=0x7f3ba413c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800e870 tx=0x7f3b9800ec70 comp rx=0 tx=0).stop 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 shutdown_connections 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3b88066470 0x7f3b88068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ba4144c80 0x7f3ba409c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ba40ac460 0x7f3ba415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 --2- 172.21.15.5:0/2365516782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba4070c20 0x7f3ba413c650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 >> 172.21.15.5:0/2365516782 conn(0x7f3ba40b0c40 msgr2=0x7f3ba40add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 shutdown_connections 2023-11-24T07:57:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.591+0000 7f3bab032640 1 -- 172.21.15.5:0/2365516782 wait complete. 2023-11-24T07:57:13.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:13.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:13.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.755+0000 7f5877091640 1 Processor -- start 2023-11-24T07:57:13.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.755+0000 7f5877091640 1 -- start start 2023-11-24T07:57:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5877091640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f58700cdfb0 0x7f58700abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5877091640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 0x7f58700ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5877091640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700ce8d0 con 0x7f58700cbd50 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5877091640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700cca80 con 0x7f58700cdfb0 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5877091640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700b2710 con 0x7f587015a710 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f586ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 0x7f58700ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f58700cdfb0 0x7f58700abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f587562e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f58700cbd50 0x7f58700cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39236/0 (socket says 172.21.15.5:39236) 2023-11-24T07:57:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f587562e640 1 -- 172.21.15.5:0/856136635 learned_addr learned my addr 172.21.15.5:0/856136635 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f58700cdfb0 0x7f58700abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:49058/0 (socket says 172.21.15.5:49058) 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f586ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 0x7f58700ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:44432/0 (socket says 172.21.15.5:44432) 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 -- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 msgr2=0x7f58700ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 --2- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 0x7f58700ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 -- 172.21.15.5:0/856136635 >> v1:172.21.15.102:6789/0 conn(0x7f58700cbd50 legacy=0x7f58700cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f5874e2d640 1 -- 172.21.15.5:0/856136635 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700b29f0 con 0x7f58700cdfb0 2023-11-24T07:57:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.759+0000 7f586f7fe640 1 -- 172.21.15.5:0/856136635 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250930411 0 0) 0x7f58700ce8d0 con 0x7f58700cbd50 2023-11-24T07:57:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5874e2d640 1 --2- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58700cdfb0 0x7f58700abf90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586400ba60 tx=0x7f586401eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0370c461b34202d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f586f7fe640 1 -- 172.21.15.5:0/856136635 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640a7bf0 con 0x7f58700cdfb0 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f586f7fe640 1 -- 172.21.15.5:0/856136635 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640a7d50 con 0x7f58700cdfb0 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f586f7fe640 1 -- 172.21.15.5:0/856136635 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640af660 con 0x7f58700cdfb0 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 -- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58700cdfb0 msgr2=0x7f58700abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 --2- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58700cdfb0 0x7f58700abf90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f586400ba60 tx=0x7f586401eb20 comp rx=0 tx=0).stop 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 -- 172.21.15.5:0/856136635 shutdown_connections 2023-11-24T07:57:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 --2- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f587015a710 0x7f58700ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 --2- 172.21.15.5:0/856136635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58700cdfb0 0x7f58700abf90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 -- 172.21.15.5:0/856136635 >> 172.21.15.5:0/856136635 conn(0x7f58700b0cb0 msgr2=0x7f58700b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 -- 172.21.15.5:0/856136635 shutdown_connections 2023-11-24T07:57:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 -- 172.21.15.5:0/856136635 wait complete. 2023-11-24T07:57:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.763+0000 7f5877091640 1 Processor -- start 2023-11-24T07:57:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- start start 2023-11-24T07:57:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58700cbd50 0x7f587015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587015a710 0x7f5870157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587015da30 con 0x7f58700cdfb0 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58701585b0 con 0x7f587015a710 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5870158890 con 0x7f58700cbd50 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32860/0 (socket says 172.21.15.5:32860) 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 -- 172.21.15.5:0/759504946 learned_addr learned my addr 172.21.15.5:0/759504946 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5874e2d640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58700cbd50 0x7f587015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f587562e640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587015a710 0x7f5870157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 -- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58700cbd50 msgr2=0x7f587015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58700cbd50 0x7f587015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 -- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587015a710 msgr2=0x7f5870157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587015a710 0x7f5870157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 -- 172.21.15.5:0/759504946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586400b6c0 con 0x7f58700cdfb0 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586ffff640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f585c00e840 tx=0x7f585c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c009510 con 0x7f58700cdfb0 2023-11-24T07:57:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00ee90 con 0x7f58700cdfb0 2023-11-24T07:57:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870070770 con 0x7f58700cdfb0 2023-11-24T07:57:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00cb80 con 0x7f58700cdfb0 2023-11-24T07:57:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587014e5a0 con 0x7f58700cdfb0 2023-11-24T07:57:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.767+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587014ee40 con 0x7f58700cdfb0 2023-11-24T07:57:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.771+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f585c00cce0 con 0x7f58700cdfb0 2023-11-24T07:57:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.771+0000 7f586d7fa640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 0x7f5854068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.771+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f585c083fe0 con 0x7f58700cdfb0 2023-11-24T07:57:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.771+0000 7f5874e2d640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 0x7f5854068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.771+0000 7f5874e2d640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 0x7f5854068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58640b1000 tx=0x7f5864008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.775+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f585c0513c0 con 0x7f58700cdfb0 2023-11-24T07:57:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.931+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58700671f0 con 0x7f58700cdfb0 2023-11-24T07:57:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.931+0000 7f586d7fa640 1 -- 172.21.15.5:0/759504946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f585c0549e0 con 0x7f58700cdfb0 2023-11-24T07:57:13.936 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 msgr2=0x7f5854068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 0x7f5854068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58640b1000 tx=0x7f5864008040 comp rx=0 tx=0).stop 2023-11-24T07:57:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 msgr2=0x7f5870157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:13.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f585c00e840 tx=0x7f585c00ec40 comp rx=0 tx=0).stop 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 shutdown_connections 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f58540664a0 0x7f5854068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f587015a710 0x7f5870157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58700cdfb0 0x7f5870157a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 --2- 172.21.15.5:0/759504946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58700cbd50 0x7f587015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:13.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 >> 172.21.15.5:0/759504946 conn(0x7f58700b0cb0 msgr2=0x7f58700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 shutdown_connections 2023-11-24T07:57:13.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:13.935+0000 7f5877091640 1 -- 172.21.15.5:0/759504946 wait complete. 2023-11-24T07:57:13.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:14.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:57:14.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:57:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.107+0000 7f64d3394640 1 Processor -- start 2023-11-24T07:57:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.107+0000 7f64d3394640 1 -- start start 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64cc15d8f0 0x7f64cc15e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 0x7f64cc0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64cc0cf1b0 0x7f64cc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0d4420 con 0x7f64cc15d8f0 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc15ecc0 con 0x7f64cc0cf1b0 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d3394640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0cdfb0 con 0x7f64cc0ced30 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64cc15d8f0 0x7f64cc15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64cc15d8f0 0x7f64cc15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32870/0 (socket says 172.21.15.5:32870) 2023-11-24T07:57:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 -- 172.21.15.5:0/2578025970 learned_addr learned my addr 172.21.15.5:0/2578025970 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1931640 1 --2- 172.21.15.5:0/2578025970 >> v2:172.21.15.102:3300/0 conn(0x7f64cc0cf1b0 0x7f64cc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d092f640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 0x7f64cc0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 -- 172.21.15.5:0/2578025970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 msgr2=0x7f64cc0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 0x7f64cc0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 -- 172.21.15.5:0/2578025970 >> v2:172.21.15.102:3300/0 conn(0x7f64cc0cf1b0 msgr2=0x7f64cc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 --2- 172.21.15.5:0/2578025970 >> v2:172.21.15.102:3300/0 conn(0x7f64cc0cf1b0 0x7f64cc0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 -- 172.21.15.5:0/2578025970 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0d4140 con 0x7f64cc15d8f0 2023-11-24T07:57:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d092f640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 0x7f64cc0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.111+0000 7f64d1130640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc15d8f0 0x7f64cc15e780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b21f0 tx=0x7f64c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fb9fabc5728e9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64c3fff640 1 -- 172.21.15.5:0/2578025970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80aa5f0 con 0x7f64cc15d8f0 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64c3fff640 1 -- 172.21.15.5:0/2578025970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80aa750 con 0x7f64cc15d8f0 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64c3fff640 1 -- 172.21.15.5:0/2578025970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80aaae0 con 0x7f64cc15d8f0 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- 172.21.15.5:0/2578025970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc15d8f0 msgr2=0x7f64cc15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc15d8f0 0x7f64cc15e780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b21f0 tx=0x7f64c801c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- 172.21.15.5:0/2578025970 shutdown_connections 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- 172.21.15.5:0/2578025970 >> v2:172.21.15.102:3300/0 conn(0x7f64cc0cf1b0 0x7f64cc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc0ced30 0x7f64cc0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- 172.21.15.5:0/2578025970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc15d8f0 0x7f64cc15e780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- 172.21.15.5:0/2578025970 >> 172.21.15.5:0/2578025970 conn(0x7f64cc09c750 msgr2=0x7f64cc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- 172.21.15.5:0/2578025970 shutdown_connections 2023-11-24T07:57:14.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- 172.21.15.5:0/2578025970 wait complete. 2023-11-24T07:57:14.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 Processor -- start 2023-11-24T07:57:14.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- start start 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64cc0cf1b0 0x7f64cc15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc15d8f0 0x7f64cc15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b20a0 con 0x7f64cc0ced30 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc156850 con 0x7f64cc0cf1b0 2023-11-24T07:57:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d3394640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc14f2a0 con 0x7f64cc15d8f0 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.115+0000 7f64d1130640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32880/0 (socket says 172.21.15.5:32880) 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 -- 172.21.15.5:0/381827793 learned_addr learned my addr 172.21.15.5:0/381827793 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d092f640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64cc0cf1b0 0x7f64cc15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1931640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc15d8f0 0x7f64cc15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 -- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc15d8f0 msgr2=0x7f64cc15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc15d8f0 0x7f64cc15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 -- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64cc0cf1b0 msgr2=0x7f64cc15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64cc0cf1b0 0x7f64cc15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 -- 172.21.15.5:0/381827793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80094d0 con 0x7f64cc0ced30 2023-11-24T07:57:14.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d1130640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64c801ab80 tx=0x7f64c801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80b3800 con 0x7f64cc0ced30 2023-11-24T07:57:14.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80b3980 con 0x7f64cc0ced30 2023-11-24T07:57:14.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80b3d30 con 0x7f64cc0ced30 2023-11-24T07:57:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc0ccb60 con 0x7f64cc0ced30 2023-11-24T07:57:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0cd120 con 0x7f64cc0ced30 2023-11-24T07:57:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc04e850 con 0x7f64cc0ced30 2023-11-24T07:57:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.119+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64c80b2380 con 0x7f64cc0ced30 2023-11-24T07:57:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.123+0000 7f64c1ffb640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 0x7f64b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.123+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64c80a7070 con 0x7f64cc0ced30 2023-11-24T07:57:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.123+0000 7f64d092f640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 0x7f64b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.123+0000 7f64d092f640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 0x7f64b0068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64cc15cd90 tx=0x7f64bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.127+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64c80eb8b0 con 0x7f64cc0ced30 2023-11-24T07:57:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64cc0cf9d0 con 0x7f64cc0ced30 2023-11-24T07:57:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64c1ffb640 1 -- 172.21.15.5:0/381827793 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64c80eeed0 con 0x7f64cc0ced30 2023-11-24T07:57:14.289 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 msgr2=0x7f64b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 0x7f64b0068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64cc15cd90 tx=0x7f64bc008040 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 msgr2=0x7f64cc156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64c801ab80 tx=0x7f64c801ad10 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 shutdown_connections 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f64b00664a0 0x7f64b0068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64cc15d8f0 0x7f64cc15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64cc0cf1b0 0x7f64cc15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 --2- 172.21.15.5:0/381827793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64cc0ced30 0x7f64cc156310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 >> 172.21.15.5:0/381827793 conn(0x7f64cc09c750 msgr2=0x7f64cc1573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 shutdown_connections 2023-11-24T07:57:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.286+0000 7f64d3394640 1 -- 172.21.15.5:0/381827793 wait complete. 2023-11-24T07:57:14.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.450+0000 7f62db216640 1 Processor -- start 2023-11-24T07:57:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.450+0000 7f62db216640 1 -- start start 2023-11-24T07:57:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62db216640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62db216640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 0x7f62d40b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62db216640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d4161290 con 0x7f62d40b2870 2023-11-24T07:57:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62db216640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d40b0b80 con 0x7f62d4161f20 2023-11-24T07:57:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62db216640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d415ebc0 con 0x7f62d40b07a0 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 0x7f62d40b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:44478/0 (socket says 172.21.15.5:44478) 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 0x7f62d40b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:49092/0 (socket says 172.21.15.5:49092) 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 -- 172.21.15.5:0/1678241934 learned_addr learned my addr 172.21.15.5:0/1678241934 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d97b3640 1 --1- 172.21.15.5:0/1678241934 >> v1:172.21.15.102:6789/0 conn(0x7f62d40b2870 0x7f62d40cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39242/0 (socket says 172.21.15.5:39242) 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 -- 172.21.15.5:0/1678241934 >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 msgr2=0x7f62d40b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/1678241934 >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 0x7f62d40b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 -- 172.21.15.5:0/1678241934 >> v1:172.21.15.102:6789/0 conn(0x7f62d40b2870 legacy=0x7f62d40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.454+0000 7f62d8fb2640 1 -- 172.21.15.5:0/1678241934 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4161550 con 0x7f62d40b07a0 2023-11-24T07:57:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/1678241934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009870 tx=0x7f62c801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6230e7896af3ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62d37fe640 1 -- 172.21.15.5:0/1678241934 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c80a7070 con 0x7f62d40b07a0 2023-11-24T07:57:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62d37fe640 1 -- 172.21.15.5:0/1678241934 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c80ab430 con 0x7f62d40b07a0 2023-11-24T07:57:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62d37fe640 1 -- 172.21.15.5:0/1678241934 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c80ab7c0 con 0x7f62d40b07a0 2023-11-24T07:57:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- 172.21.15.5:0/1678241934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 msgr2=0x7f62d41619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 --2- 172.21.15.5:0/1678241934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009870 tx=0x7f62c801c540 comp rx=0 tx=0).stop 2023-11-24T07:57:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- 172.21.15.5:0/1678241934 shutdown_connections 2023-11-24T07:57:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 --2- 172.21.15.5:0/1678241934 >> v2:172.21.15.102:3300/0 conn(0x7f62d4161f20 0x7f62d40b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 --2- 172.21.15.5:0/1678241934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d41619e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- 172.21.15.5:0/1678241934 >> 172.21.15.5:0/1678241934 conn(0x7f62d40b1d50 msgr2=0x7f62d40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- 172.21.15.5:0/1678241934 shutdown_connections 2023-11-24T07:57:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- 172.21.15.5:0/1678241934 wait complete. 2023-11-24T07:57:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 Processor -- start 2023-11-24T07:57:14.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.458+0000 7f62db216640 1 -- start start 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d40afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 0x7f62d4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d40aeca0 con 0x7f62d40b2870 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d40aef80 con 0x7f62d4161f20 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d40af260 con 0x7f62d40b07a0 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32894/0 (socket says 172.21.15.5:32894) 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 -- 172.21.15.5:0/3613809500 learned_addr learned my addr 172.21.15.5:0/3613809500 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d40afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d97b3640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 0x7f62d4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 -- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 msgr2=0x7f62d40afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d40afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 -- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 msgr2=0x7f62d4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 0x7f62d4155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 -- 172.21.15.5:0/3613809500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80094d0 con 0x7f62d40b2870 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d40afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d97b3640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 0x7f62d4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d3fff640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62c000e840 tx=0x7f62c000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0009510 con 0x7f62d40b2870 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000ee90 con 0x7f62d40b2870 2023-11-24T07:57:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000cb80 con 0x7f62d40b2870 2023-11-24T07:57:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d40af540 con 0x7f62d40b2870 2023-11-24T07:57:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d40ae920 con 0x7f62d40b2870 2023-11-24T07:57:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.462+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d404e850 con 0x7f62d40b2870 2023-11-24T07:57:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.466+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62c000cce0 con 0x7f62d40b2870 2023-11-24T07:57:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.466+0000 7f62d17fa640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 0x7f62b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.466+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62c0083f60 con 0x7f62d40b2870 2023-11-24T07:57:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.466+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 0x7f62b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.466+0000 7f62d8fb2640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 0x7f62b8068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009870 tx=0x7f62c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.470+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62c0051340 con 0x7f62d40b2870 2023-11-24T07:57:14.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.626+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62d40c5270 con 0x7f62d40b2870 2023-11-24T07:57:14.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.626+0000 7f62d17fa640 1 -- 172.21.15.5:0/3613809500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62c0054960 con 0x7f62d40b2870 2023-11-24T07:57:14.632 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 msgr2=0x7f62b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 0x7f62b8068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009870 tx=0x7f62c8008040 comp rx=0 tx=0).stop 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 msgr2=0x7f62d40ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62c000e840 tx=0x7f62c000ec40 comp rx=0 tx=0).stop 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 shutdown_connections 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62b80664a0 0x7f62b8068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62d4161f20 0x7f62d4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40b2870 0x7f62d40ae3e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 --2- 172.21.15.5:0/3613809500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62d40b07a0 0x7f62d40afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 >> 172.21.15.5:0/3613809500 conn(0x7f62d40b1d50 msgr2=0x7f62d406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 shutdown_connections 2023-11-24T07:57:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.630+0000 7f62db216640 1 -- 172.21.15.5:0/3613809500 wait complete. 2023-11-24T07:57:14.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 Processor -- start 2023-11-24T07:57:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 -- start start 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce415d7b0 0x7f8ce40d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40d2080 0x7f8ce406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40cefd0 con 0x7f8ce40cead0 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40cf2b0 con 0x7f8ce415d7b0 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cebdf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce406b3f0 con 0x7f8ce40d2080 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce415d7b0 0x7f8ce40d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ce415d7b0 0x7f8ce40d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32904/0 (socket says 172.21.15.5:32904) 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 -- 172.21.15.5:0/1783017113 learned_addr learned my addr 172.21.15.5:0/1783017113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8cea392640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40d2080 0x7f8ce406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 -- 172.21.15.5:0/1783017113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40d2080 msgr2=0x7f8ce406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40d2080 0x7f8ce406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 -- 172.21.15.5:0/1783017113 >> v1:172.21.15.102:6789/0 conn(0x7f8ce40cead0 legacy=0x7f8ce40d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.794+0000 7f8ce9b91640 1 -- 172.21.15.5:0/1783017113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce406b6d0 con 0x7f8ce415d7b0 2023-11-24T07:57:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8ce9b91640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40d10d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009870 tx=0x7f8ce001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78de666ebeb62d50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8ce8b8f640 1 -- 172.21.15.5:0/1783017113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab610 con 0x7f8ce415d7b0 2023-11-24T07:57:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8ce8b8f640 1 -- 172.21.15.5:0/1783017113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce00ab770 con 0x7f8ce415d7b0 2023-11-24T07:57:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8ce8b8f640 1 -- 172.21.15.5:0/1783017113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00abb00 con 0x7f8ce415d7b0 2023-11-24T07:57:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1783017113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415d7b0 msgr2=0x7f8ce40d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40d10d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009870 tx=0x7f8ce001c3f0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1783017113 shutdown_connections 2023-11-24T07:57:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40d2080 0x7f8ce406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1783017113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40d10d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1783017113 >> 172.21.15.5:0/1783017113 conn(0x7f8ce40d33b0 msgr2=0x7f8ce40d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1783017113 shutdown_connections 2023-11-24T07:57:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.798+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1783017113 wait complete. 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 Processor -- start 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- start start 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40cead0 0x7f8ce41525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153050 con 0x7f8ce40d2080 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40ccc70 con 0x7f8ce415d7b0 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153c00 con 0x7f8ce40cead0 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9b91640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40cead0 0x7f8ce41525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32912/0 (socket says 172.21.15.5:32912) 2023-11-24T07:57:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 -- 172.21.15.5:0/1318535712 learned_addr learned my addr 172.21.15.5:0/1318535712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cea392640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 -- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40cead0 msgr2=0x7f8ce41525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40cead0 0x7f8ce41525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 -- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ce415d7b0 msgr2=0x7f8ce40c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 -- 172.21.15.5:0/1318535712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00094d0 con 0x7f8ce40d2080 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8ce9390640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c390 tx=0x7f8cd400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40052d0 con 0x7f8ce40d2080 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4005430 con 0x7f8ce40d2080 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce4153ee0 con 0x7f8ce40d2080 2023-11-24T07:57:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4003820 con 0x7f8ce40d2080 2023-11-24T07:57:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.802+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce41544a0 con 0x7f8ce40d2080 2023-11-24T07:57:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40ca460 con 0x7f8ce40d2080 2023-11-24T07:57:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cd4003980 con 0x7f8ce40d2080 2023-11-24T07:57:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8cda7fc640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 0x7f8cc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cd4083300 con 0x7f8ce40d2080 2023-11-24T07:57:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8ce9b91640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 0x7f8cc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.806+0000 7f8ce9b91640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 0x7f8cc8068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00af000 tx=0x7f8ce00b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.810+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cd4050820 con 0x7f8ce40d2080 2023-11-24T07:57:14.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.970+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce404e850 con 0x7f8ce40d2080 2023-11-24T07:57:14.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.970+0000 7f8cda7fc640 1 -- 172.21.15.5:0/1318535712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8cd4053e40 con 0x7f8ce40d2080 2023-11-24T07:57:14.975 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:14.975 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 msgr2=0x7f8cc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 0x7f8cc8068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00af000 tx=0x7f8ce00b6040 comp rx=0 tx=0).stop 2023-11-24T07:57:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 msgr2=0x7f8ce4152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c390 tx=0x7f8cd400c850 comp rx=0 tx=0).stop 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 shutdown_connections 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8cc8066470 0x7f8cc8068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ce415d7b0 0x7f8ce40c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ce40d2080 0x7f8ce4152b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 --2- 172.21.15.5:0/1318535712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ce40cead0 0x7f8ce41525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 >> 172.21.15.5:0/1318535712 conn(0x7f8ce40d33b0 msgr2=0x7f8ce415ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 shutdown_connections 2023-11-24T07:57:14.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:14.974+0000 7f8cebdf5640 1 -- 172.21.15.5:0/1318535712 wait complete. 2023-11-24T07:57:14.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:14.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.138+0000 7fa3c658d640 1 Processor -- start 2023-11-24T07:57:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.138+0000 7fa3c658d640 1 -- start start 2023-11-24T07:57:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.138+0000 7fa3c658d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3c00cdfb0 0x7fa3c00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3c658d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa3c00cbd50 0x7fa3c00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3c658d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c00b2710 con 0x7fa3c015a710 2023-11-24T07:57:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3c658d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00cca80 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3c658d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00b29f0 con 0x7fa3c00cbd50 2023-11-24T07:57:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bf7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa3c015a710 0x7fa3c00ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39260/0 (socket says 172.21.15.5:39260) 2023-11-24T07:57:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/576318239 learned_addr learned my addr 172.21.15.5:0/576318239 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 --2- 172.21.15.5:0/576318239 >> v2:172.21.15.5:3300/0 conn(0x7fa3c00cdfb0 0x7fa3c00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3c4b2a640 1 --2- 172.21.15.5:0/576318239 >> v2:172.21.15.102:3300/0 conn(0x7fa3c00cbd50 0x7fa3c00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 -- 172.21.15.5:0/576318239 >> v2:172.21.15.102:3300/0 conn(0x7fa3c00cbd50 msgr2=0x7fa3c00cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 --2- 172.21.15.5:0/576318239 >> v2:172.21.15.102:3300/0 conn(0x7fa3c00cbd50 0x7fa3c00cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 -- 172.21.15.5:0/576318239 >> v1:172.21.15.102:6789/0 conn(0x7fa3c015a710 legacy=0x7fa3c00ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 -- 172.21.15.5:0/576318239 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00b2cd0 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3beffd640 1 -- 172.21.15.5:0/576318239 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47309673 0 0) 0x7fa3c00b2710 con 0x7fa3c015a710 2023-11-24T07:57:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.142+0000 7fa3bffff640 1 --2- 172.21.15.5:0/576318239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c00cdfb0 0x7fa3c00abf90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00aead0 tx=0x7fa3b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4b5f8cbdb1451c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3beffd640 1 -- 172.21.15.5:0/576318239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00ab650 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3beffd640 1 -- 172.21.15.5:0/576318239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00ab7b0 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3beffd640 1 -- 172.21.15.5:0/576318239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00abb40 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- 172.21.15.5:0/576318239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c00cdfb0 msgr2=0x7fa3c00abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- 172.21.15.5:0/576318239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c00cdfb0 0x7fa3c00abf90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00aead0 tx=0x7fa3b001c430 comp rx=0 tx=0).stop 2023-11-24T07:57:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- 172.21.15.5:0/576318239 shutdown_connections 2023-11-24T07:57:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- 172.21.15.5:0/576318239 >> v2:172.21.15.102:3300/0 conn(0x7fa3c00cbd50 0x7fa3c00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- 172.21.15.5:0/576318239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c00cdfb0 0x7fa3c00abf90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- 172.21.15.5:0/576318239 >> 172.21.15.5:0/576318239 conn(0x7fa3c00b0cb0 msgr2=0x7fa3c00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- 172.21.15.5:0/576318239 shutdown_connections 2023-11-24T07:57:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- 172.21.15.5:0/576318239 wait complete. 2023-11-24T07:57:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 Processor -- start 2023-11-24T07:57:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- start start 2023-11-24T07:57:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00cbd50 0x7fa3c01520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 0x7fa3c01671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0159230 con 0x7fa3c015a710 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0152960 con 0x7fa3c00cbd50 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c658d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01678d0 con 0x7fa3c00cdfb0 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c4b2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c4b2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32926/0 (socket says 172.21.15.5:32926) 2023-11-24T07:57:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.146+0000 7fa3c4b2a640 1 -- 172.21.15.5:0/4055399513 learned_addr learned my addr 172.21.15.5:0/4055399513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 0x7fa3c01671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bffff640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00cbd50 0x7fa3c01520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 -- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 msgr2=0x7fa3c01671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 0x7fa3c01671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 -- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00cbd50 msgr2=0x7fa3c01520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00cbd50 0x7fa3c01520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 -- 172.21.15.5:0/4055399513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009420 con 0x7fa3c015a710 2023-11-24T07:57:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 0x7fa3c01671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c4b2a640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009dd0 tx=0x7fa3b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8014480 con 0x7fa3c015a710 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800f040 con 0x7fa3c015a710 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8014840 con 0x7fa3c015a710 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c0167bb0 con 0x7fa3c015a710 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c0159480 con 0x7fa3c015a710 2023-11-24T07:57:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c00671f0 con 0x7fa3c015a710 2023-11-24T07:57:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.150+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3b80149a0 con 0x7fa3c015a710 2023-11-24T07:57:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.154+0000 7fa3bcff9640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.154+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3b8084a20 con 0x7fa3c015a710 2023-11-24T07:57:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.154+0000 7fa3bffff640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.154+0000 7fa3bffff640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 0x7fa3ac068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00af000 tx=0x7fa3b00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.158+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3b8051e90 con 0x7fa3c015a710 2023-11-24T07:57:15.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3c006b460 con 0x7fa3c015a710 2023-11-24T07:57:15.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3bcff9640 1 -- 172.21.15.5:0/4055399513 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3b80180a0 con 0x7fa3c015a710 2023-11-24T07:57:15.326 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 msgr2=0x7fa3ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 0x7fa3ac068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00af000 tx=0x7fa3b00a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 msgr2=0x7fa3c01518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009dd0 tx=0x7fa3b800c490 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 shutdown_connections 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c015a710 0x7fa3c01518a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c00cdfb0 0x7fa3c01671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 --2- 172.21.15.5:0/4055399513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00cbd50 0x7fa3c01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 >> 172.21.15.5:0/4055399513 conn(0x7fa3c00b0cb0 msgr2=0x7fa3c00ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 shutdown_connections 2023-11-24T07:57:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.322+0000 7fa3c658d640 1 -- 172.21.15.5:0/4055399513 wait complete. 2023-11-24T07:57:15.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.486+0000 7f4b9c3df640 1 Processor -- start 2023-11-24T07:57:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 -- start start 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 0x7f4b940ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b940caa60 0x7f4b940cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 0x7f4b9406c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9406ceb0 con 0x7f4b940caa60 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b940caec0 con 0x7f4b9406c520 2023-11-24T07:57:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9c3df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9406b970 con 0x7f4b9415d610 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b940caa60 0x7f4b940cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b940caa60 0x7f4b940cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32942/0 (socket says 172.21.15.5:32942) 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 -- 172.21.15.5:0/3638905348 learned_addr learned my addr 172.21.15.5:0/3638905348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9a97c640 1 --2- 172.21.15.5:0/3638905348 >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 0x7f4b9406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9a17b640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 0x7f4b940ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 -- 172.21.15.5:0/3638905348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 msgr2=0x7f4b940ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 0x7f4b940ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 -- 172.21.15.5:0/3638905348 >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 msgr2=0x7f4b9406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 --2- 172.21.15.5:0/3638905348 >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 0x7f4b9406c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9997a640 1 -- 172.21.15.5:0/3638905348 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9406bc50 con 0x7f4b940caa60 2023-11-24T07:57:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9a17b640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 0x7f4b940ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.490+0000 7f4b9a97c640 1 --2- 172.21.15.5:0/3638905348 >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 0x7f4b9406c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:15.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9997a640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b940caa60 0x7f4b940cb8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b94072490 tx=0x7f4b8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6178f09310126fb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b99179640 1 -- 172.21.15.5:0/3638905348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840aa5f0 con 0x7f4b940caa60 2023-11-24T07:57:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b99179640 1 -- 172.21.15.5:0/3638905348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b840aa750 con 0x7f4b940caa60 2023-11-24T07:57:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b99179640 1 -- 172.21.15.5:0/3638905348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840aaae0 con 0x7f4b940caa60 2023-11-24T07:57:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3638905348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b940caa60 msgr2=0x7f4b940cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b940caa60 0x7f4b940cb8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b94072490 tx=0x7f4b8401c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3638905348 shutdown_connections 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3638905348 >> v2:172.21.15.102:3300/0 conn(0x7f4b9406c520 0x7f4b9406c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b940caa60 0x7f4b940cb8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3638905348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9415d610 0x7f4b940ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3638905348 >> 172.21.15.5:0/3638905348 conn(0x7f4b940b2f10 msgr2=0x7f4b940b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3638905348 shutdown_connections 2023-11-24T07:57:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3638905348 wait complete. 2023-11-24T07:57:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 Processor -- start 2023-11-24T07:57:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.494+0000 7f4b9c3df640 1 -- start start 2023-11-24T07:57:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9406c520 0x7f4b9413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b940caa60 0x7f4b940b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940b5340 con 0x7f4b9415d610 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940b46c0 con 0x7f4b940caa60 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940b49a0 con 0x7f4b9406c520 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32948/0 (socket says 172.21.15.5:32948) 2023-11-24T07:57:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 -- 172.21.15.5:0/3486508973 learned_addr learned my addr 172.21.15.5:0/3486508973 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a17b640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9406c520 0x7f4b9413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9997a640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b940caa60 0x7f4b940b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 -- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9406c520 msgr2=0x7f4b9413fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9406c520 0x7f4b9413fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 -- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b940caa60 msgr2=0x7f4b940b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b940caa60 0x7f4b940b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 -- 172.21.15.5:0/3486508973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840094d0 con 0x7f4b9415d610 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9a97c640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007db0 tx=0x7f4b8c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0039a0 con 0x7f4b9415d610 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c00f040 con 0x7f4b9415d610 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c003d60 con 0x7f4b9415d610 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b940b4c80 con 0x7f4b9415d610 2023-11-24T07:57:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94140090 con 0x7f4b9415d610 2023-11-24T07:57:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.498+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b940b5480 con 0x7f4b9415d610 2023-11-24T07:57:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.502+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b8c004030 con 0x7f4b9415d610 2023-11-24T07:57:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.502+0000 7f4b8affd640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.502+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b8c083fe0 con 0x7f4b9415d610 2023-11-24T07:57:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.502+0000 7f4b9a17b640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.502+0000 7f4b9a17b640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009950 tx=0x7f4b90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.506+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b940b5480 con 0x7f4b9415d610 2023-11-24T07:57:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b940b5480 con 0x7f4b9415d610 2023-11-24T07:57:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b8affd640 1 -- 172.21.15.5:0/3486508973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b940b5480 con 0x7f4b9415d610 2023-11-24T07:57:15.665 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 msgr2=0x7f4b78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009950 tx=0x7f4b90008040 comp rx=0 tx=0).stop 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 msgr2=0x7f4b94150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007db0 tx=0x7f4b8c00d4a0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 shutdown_connections 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9415d610 0x7f4b94150990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b940caa60 0x7f4b940b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 --2- 172.21.15.5:0/3486508973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b9406c520 0x7f4b9413fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 >> 172.21.15.5:0/3486508973 conn(0x7f4b940b2f10 msgr2=0x7f4b94157140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 shutdown_connections 2023-11-24T07:57:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.662+0000 7f4b9c3df640 1 -- 172.21.15.5:0/3486508973 wait complete. 2023-11-24T07:57:15.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:15.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.826+0000 7fc663e79640 1 Processor -- start 2023-11-24T07:57:15.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 -- start start 2023-11-24T07:57:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c1619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c161290 con 0x7fc65c161f20 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0b0b80 con 0x7fc65c0b15f0 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc663e79640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c15ebc0 con 0x7fc65c0b07a0 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc661414640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc65c161f20 0x7fc65c0b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58354/0 (socket says 172.21.15.5:58354) 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32960/0 (socket says 172.21.15.5:32960) 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc661414640 1 -- 172.21.15.5:0/1040479359 learned_addr learned my addr 172.21.15.5:0/1040479359 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc661c15640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c1619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 -- 172.21.15.5:0/1040479359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 msgr2=0x7fc65c1619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c1619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 -- 172.21.15.5:0/1040479359 >> v1:172.21.15.5:6789/0 conn(0x7fc65c161f20 legacy=0x7fc65c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc662416640 1 -- 172.21.15.5:0/1040479359 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c161550 con 0x7fc65c0b15f0 2023-11-24T07:57:15.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.830+0000 7fc660c13640 1 -- 172.21.15.5:0/1040479359 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136095518 0 0) 0x7fc65c161290 con 0x7fc65c161f20 2023-11-24T07:57:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc662416640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc654009d90 tx=0x7fc65401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ef90d8f860abf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc660c13640 1 -- 172.21.15.5:0/1040479359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540a5900 con 0x7fc65c0b15f0 2023-11-24T07:57:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc660c13640 1 -- 172.21.15.5:0/1040479359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540a5a60 con 0x7fc65c0b15f0 2023-11-24T07:57:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc660c13640 1 -- 172.21.15.5:0/1040479359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540a5df0 con 0x7fc65c0b15f0 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- 172.21.15.5:0/1040479359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c0b15f0 msgr2=0x7fc65c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc654009d90 tx=0x7fc65401c950 comp rx=0 tx=0).stop 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- 172.21.15.5:0/1040479359 shutdown_connections 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0cc9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 --2- 172.21.15.5:0/1040479359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c1619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- 172.21.15.5:0/1040479359 >> 172.21.15.5:0/1040479359 conn(0x7fc65c0b1d50 msgr2=0x7fc65c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- 172.21.15.5:0/1040479359 shutdown_connections 2023-11-24T07:57:15.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- 172.21.15.5:0/1040479359 wait complete. 2023-11-24T07:57:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 Processor -- start 2023-11-24T07:57:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.834+0000 7fc663e79640 1 -- start start 2023-11-24T07:57:15.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0b2d40 con 0x7fc65c161f20 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0b3020 con 0x7fc65c0b15f0 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0b3300 con 0x7fc65c0b07a0 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32974/0 (socket says 172.21.15.5:32974) 2023-11-24T07:57:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 -- 172.21.15.5:0/1585752233 learned_addr learned my addr 172.21.15.5:0/1585752233 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc661c15640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc661414640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 -- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 msgr2=0x7fc65c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 -- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc65c0b15f0 msgr2=0x7fc65c0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 -- 172.21.15.5:0/1585752233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009a70 con 0x7fc65c161f20 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc662416640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6540b0040 tx=0x7fc6540196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b9860 con 0x7fc65c161f20 2023-11-24T07:57:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540b99c0 con 0x7fc65c161f20 2023-11-24T07:57:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b9d70 con 0x7fc65c161f20 2023-11-24T07:57:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c0b35e0 con 0x7fc65c161f20 2023-11-24T07:57:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c15a3d0 con 0x7fc65c161f20 2023-11-24T07:57:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.838+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c15a5c0 con 0x7fc65c161f20 2023-11-24T07:57:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.842+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc6540ad440 con 0x7fc65c161f20 2023-11-24T07:57:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.842+0000 7fc6527fc640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 0x7fc640068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.842+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc65411f200 con 0x7fc65c161f20 2023-11-24T07:57:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.842+0000 7fc661c15640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 0x7fc640068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.842+0000 7fc661c15640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 0x7fc640068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc658007a60 tx=0x7fc658008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:15.846+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6540ec840 con 0x7fc65c161f20 2023-11-24T07:57:16.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc65c04e850 con 0x7fc65c161f20 2023-11-24T07:57:16.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc6527fc640 1 -- 172.21.15.5:0/1585752233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6540efe60 con 0x7fc65c161f20 2023-11-24T07:57:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 msgr2=0x7fc640068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 0x7fc640068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc658007a60 tx=0x7fc658008040 comp rx=0 tx=0).stop 2023-11-24T07:57:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 msgr2=0x7fc65c09a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6540b0040 tx=0x7fc6540196f0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 shutdown_connections 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc640066470 0x7fc640068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc65c161f20 0x7fc65c09a5d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc65c0b15f0 0x7fc65c0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 --2- 172.21.15.5:0/1585752233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc65c0b07a0 0x7fc65c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 >> 172.21.15.5:0/1585752233 conn(0x7fc65c0b1d50 msgr2=0x7fc65c06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 shutdown_connections 2023-11-24T07:57:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.002+0000 7fc663e79640 1 -- 172.21.15.5:0/1585752233 wait complete. 2023-11-24T07:57:16.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 Processor -- start 2023-11-24T07:57:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 -- start start 2023-11-24T07:57:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23e00ac630 0x7f23e00706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 0x7f23e006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e0145060 con 0x7f23e0144c80 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e0071fd0 con 0x7f23e00ac630 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23e530f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e0071450 con 0x7f23e0070c20 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23e00ac630 0x7f23e00706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23e00ac630 0x7f23e00706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32982/0 (socket says 172.21.15.5:32982) 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 -- 172.21.15.5:0/247825590 learned_addr learned my addr 172.21.15.5:0/247825590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23df7fe640 1 --2- 172.21.15.5:0/247825590 >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 0x7f23e006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 -- 172.21.15.5:0/247825590 >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 msgr2=0x7f23e006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 --2- 172.21.15.5:0/247825590 >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 0x7f23e006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 -- 172.21.15.5:0/247825590 >> v1:172.21.15.102:6789/0 conn(0x7f23e0144c80 legacy=0x7f23e00abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23d7fff640 1 -- 172.21.15.5:0/247825590 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0071730 con 0x7f23e00ac630 2023-11-24T07:57:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.170+0000 7f23df7fe640 1 --2- 172.21.15.5:0/247825590 >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 0x7f23e006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23d7fff640 1 --2- 172.21.15.5:0/247825590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e00706e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ce840 tx=0x7f23c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bc814252a2beb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23de7fc640 1 -- 172.21.15.5:0/247825590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80aa5f0 con 0x7f23e00ac630 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23de7fc640 1 -- 172.21.15.5:0/247825590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80aa750 con 0x7f23e00ac630 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23de7fc640 1 -- 172.21.15.5:0/247825590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80aaae0 con 0x7f23e00ac630 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- 172.21.15.5:0/247825590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 msgr2=0x7f23e00706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 --2- 172.21.15.5:0/247825590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e00706e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ce840 tx=0x7f23c801c490 comp rx=0 tx=0).stop 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- 172.21.15.5:0/247825590 shutdown_connections 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 --2- 172.21.15.5:0/247825590 >> v2:172.21.15.102:3300/0 conn(0x7f23e0070c20 0x7f23e006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 --2- 172.21.15.5:0/247825590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e00706e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- 172.21.15.5:0/247825590 >> 172.21.15.5:0/247825590 conn(0x7f23e00b0c40 msgr2=0x7f23e00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- 172.21.15.5:0/247825590 shutdown_connections 2023-11-24T07:57:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- 172.21.15.5:0/247825590 wait complete. 2023-11-24T07:57:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 Processor -- start 2023-11-24T07:57:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.174+0000 7f23e530f640 1 -- start start 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 0x7f23e0139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23e0144c80 0x7f23e013daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e013f8e0 con 0x7f23e00ac630 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e013e030 con 0x7f23e0070c20 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0158c60 con 0x7f23e0144c80 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32994/0 (socket says 172.21.15.5:32994) 2023-11-24T07:57:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 -- 172.21.15.5:0/2200137557 learned_addr learned my addr 172.21.15.5:0/2200137557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23df7fe640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23e0144c80 0x7f23e013daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23deffd640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 0x7f23e0139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 -- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23e0144c80 msgr2=0x7f23e013daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23e0144c80 0x7f23e013daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 -- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 msgr2=0x7f23e0139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 0x7f23e0139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 -- 172.21.15.5:0/2200137557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80094d0 con 0x7f23e00ac630 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23deffd640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 0x7f23e0139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d7fff640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23c801a0c0 tx=0x7f23c801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80b3800 con 0x7f23e00ac630 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80b3960 con 0x7f23e00ac630 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80b3cf0 con 0x7f23e00ac630 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e013fac0 con 0x7f23e00ac630 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e0140080 con 0x7f23e00ac630 2023-11-24T07:57:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.178+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e00b1ba0 con 0x7f23e00ac630 2023-11-24T07:57:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.182+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f23c80c73a0 con 0x7f23e00ac630 2023-11-24T07:57:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.182+0000 7f23d77fe640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 0x7f23c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.182+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23c80a7070 con 0x7f23e00ac630 2023-11-24T07:57:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.182+0000 7f23deffd640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 0x7f23c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.182+0000 7f23deffd640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 0x7f23c0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23e01417e0 tx=0x7f23d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.186+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23c80ebcd0 con 0x7f23e00ac630 2023-11-24T07:57:16.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.342+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23e0140270 con 0x7f23e00ac630 2023-11-24T07:57:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23d77fe640 1 -- 172.21.15.5:0/2200137557 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f23c80c3090 con 0x7f23e00ac630 2023-11-24T07:57:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:16.349 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 msgr2=0x7f23c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 0x7f23c0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23e01417e0 tx=0x7f23d0008040 comp rx=0 tx=0).stop 2023-11-24T07:57:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 msgr2=0x7f23e015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23c801a0c0 tx=0x7f23c801acd0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 shutdown_connections 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f23c00664a0 0x7f23c0068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23e0144c80 0x7f23e013daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23e00ac630 0x7f23e015c1a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 --2- 172.21.15.5:0/2200137557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23e0070c20 0x7f23e0139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 >> 172.21.15.5:0/2200137557 conn(0x7f23e00b0c40 msgr2=0x7f23e00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 shutdown_connections 2023-11-24T07:57:16.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.346+0000 7f23e530f640 1 -- 172.21.15.5:0/2200137557 wait complete. 2023-11-24T07:57:16.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:16.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.510+0000 7feb87efe640 1 Processor -- start 2023-11-24T07:57:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 -- start start 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb800b4210 0x7feb800b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb8015db40 0x7feb8015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb80147190 con 0x7feb80146820 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb80146c00 con 0x7feb8015db40 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb87efe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8006bf90 con 0x7feb800b4210 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb8015db40 0x7feb8015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb8015db40 0x7feb8015df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33006/0 (socket says 172.21.15.5:33006) 2023-11-24T07:57:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 -- 172.21.15.5:0/3622713197 learned_addr learned my addr 172.21.15.5:0/3622713197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb85499640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb800b4210 0x7feb800b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 -- 172.21.15.5:0/3622713197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb800b4210 msgr2=0x7feb800b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb800b4210 0x7feb800b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 -- 172.21.15.5:0/3622713197 >> v1:172.21.15.102:6789/0 conn(0x7feb80146820 legacy=0x7feb80070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.514+0000 7feb8649b640 1 -- 172.21.15.5:0/3622713197 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800b4bb0 con 0x7feb8015db40 2023-11-24T07:57:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb8649b640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8015df90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb78009e50 tx=0x7feb7801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d411435422e00e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb84c98640 1 -- 172.21.15.5:0/3622713197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780a58a0 con 0x7feb8015db40 2023-11-24T07:57:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb84c98640 1 -- 172.21.15.5:0/3622713197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780a5a00 con 0x7feb8015db40 2023-11-24T07:57:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb84c98640 1 -- 172.21.15.5:0/3622713197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780a5d90 con 0x7feb8015db40 2023-11-24T07:57:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- 172.21.15.5:0/3622713197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 msgr2=0x7feb8015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8015df90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb78009e50 tx=0x7feb7801c9e0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- 172.21.15.5:0/3622713197 shutdown_connections 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb800b4210 0x7feb800b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 --2- 172.21.15.5:0/3622713197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8015df90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- 172.21.15.5:0/3622713197 >> 172.21.15.5:0/3622713197 conn(0x7feb800b2f10 msgr2=0x7feb800b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- 172.21.15.5:0/3622713197 shutdown_connections 2023-11-24T07:57:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- 172.21.15.5:0/3622713197 wait complete. 2023-11-24T07:57:16.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 Processor -- start 2023-11-24T07:57:16.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.518+0000 7feb87efe640 1 -- start start 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb800b4210 0x7feb801383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb80146820 0x7feb8013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80138de0 con 0x7feb8015db40 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb801f6310 con 0x7feb800b4210 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8013ac00 con 0x7feb80146820 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33014/0 (socket says 172.21.15.5:33014) 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 -- 172.21.15.5:0/274288080 learned_addr learned my addr 172.21.15.5:0/274288080 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb85499640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb80146820 0x7feb8013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb85c9a640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb800b4210 0x7feb801383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 -- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb80146820 msgr2=0x7feb8013a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb80146820 0x7feb8013a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 -- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb800b4210 msgr2=0x7feb801383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb800b4210 0x7feb801383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 -- 172.21.15.5:0/274288080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009b30 con 0x7feb8015db40 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb8649b640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb7801a610 tx=0x7feb78019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780b8670 con 0x7feb8015db40 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780b87d0 con 0x7feb8015db40 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8006d030 con 0x7feb8015db40 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780b8b80 con 0x7feb8015db40 2023-11-24T07:57:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb80135fc0 con 0x7feb8015db40 2023-11-24T07:57:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.522+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80138f50 con 0x7feb8015db40 2023-11-24T07:57:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.526+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb780b8ce0 con 0x7feb8015db40 2023-11-24T07:57:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.526+0000 7feb767fc640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 0x7feb64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.526+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb7811f330 con 0x7feb8015db40 2023-11-24T07:57:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.526+0000 7feb85c9a640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 0x7feb64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.526+0000 7feb85c9a640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 0x7feb64068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb80141dc0 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.530+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb780ec8e0 con 0x7feb8015db40 2023-11-24T07:57:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.686+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb8004e850 con 0x7feb8015db40 2023-11-24T07:57:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.686+0000 7feb767fc640 1 -- 172.21.15.5:0/274288080 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb780eff00 con 0x7feb8015db40 2023-11-24T07:57:16.692 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 msgr2=0x7feb64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 0x7feb64068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb80141dc0 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 msgr2=0x7feb8013f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb7801a610 tx=0x7feb78019780 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 shutdown_connections 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feb64066470 0x7feb64068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb8015db40 0x7feb8013f730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb80146820 0x7feb8013a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 --2- 172.21.15.5:0/274288080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb800b4210 0x7feb801383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 >> 172.21.15.5:0/274288080 conn(0x7feb800b2f10 msgr2=0x7feb801453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 shutdown_connections 2023-11-24T07:57:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.690+0000 7feb87efe640 1 -- 172.21.15.5:0/274288080 wait complete. 2023-11-24T07:57:16.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 Processor -- start 2023-11-24T07:57:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 -- start start 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab240cb9b0 0x7fab2406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240cbd90 0x7fab2415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24159630 con 0x7fab240ce5d0 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2415bba0 con 0x7fab240cb9b0 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab29c9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240cdd50 con 0x7fab240cbd90 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab237fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab240cb9b0 0x7fab2406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab23fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fab240ce5d0 0x7fab2415bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58364/0 (socket says 172.21.15.5:58364) 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab23fff640 1 -- 172.21.15.5:0/3216285939 learned_addr learned my addr 172.21.15.5:0/3216285939 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.854+0000 7fab237fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab240cb9b0 0x7fab2406e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33016/0 (socket says 172.21.15.5:33016) 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab22ffd640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240cbd90 0x7fab2415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab237fe640 1 -- 172.21.15.5:0/3216285939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240cbd90 msgr2=0x7fab2415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab237fe640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240cbd90 0x7fab2415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab237fe640 1 -- 172.21.15.5:0/3216285939 >> v1:172.21.15.5:6789/0 conn(0x7fab240ce5d0 legacy=0x7fab2415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab237fe640 1 -- 172.21.15.5:0/3216285939 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2415f6d0 con 0x7fab240cb9b0 2023-11-24T07:57:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab237fe640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab2406e3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab140097c0 tx=0x7fab1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d54a8d66cdf434d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab227fc640 1 -- 172.21.15.5:0/3216285939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140ab650 con 0x7fab240cb9b0 2023-11-24T07:57:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab227fc640 1 -- 172.21.15.5:0/3216285939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140ab7b0 con 0x7fab240cb9b0 2023-11-24T07:57:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.858+0000 7fab227fc640 1 -- 172.21.15.5:0/3216285939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140abb40 con 0x7fab240cb9b0 2023-11-24T07:57:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- 172.21.15.5:0/3216285939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 msgr2=0x7fab2406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab2406e3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab140097c0 tx=0x7fab1401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- 172.21.15.5:0/3216285939 shutdown_connections 2023-11-24T07:57:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240cbd90 0x7fab2415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- 172.21.15.5:0/3216285939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab2406e3f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- 172.21.15.5:0/3216285939 >> 172.21.15.5:0/3216285939 conn(0x7fab240b0cb0 msgr2=0x7fab240b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- 172.21.15.5:0/3216285939 shutdown_connections 2023-11-24T07:57:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- 172.21.15.5:0/3216285939 wait complete. 2023-11-24T07:57:16.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 Processor -- start 2023-11-24T07:57:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- start start 2023-11-24T07:57:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab240cbd90 0x7fab24151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240ce5d0 0x7fab2415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240b39e0 con 0x7fab240cb9b0 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ad960 con 0x7fab240cbd90 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.862+0000 7fab29c9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ac4d0 con 0x7fab240ce5d0 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33026/0 (socket says 172.21.15.5:33026) 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 -- 172.21.15.5:0/4075476099 learned_addr learned my addr 172.21.15.5:0/4075476099 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab23fff640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240ce5d0 0x7fab2415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab22ffd640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab240cbd90 0x7fab24151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 -- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240ce5d0 msgr2=0x7fab2415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240ce5d0 0x7fab2415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 -- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab240cbd90 msgr2=0x7fab24151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab240cbd90 0x7fab24151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 -- 172.21.15.5:0/4075476099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009420 con 0x7fab240cb9b0 2023-11-24T07:57:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab237fe640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab140ad040 tx=0x7fab1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140b5810 con 0x7fab240cb9b0 2023-11-24T07:57:16.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140b5970 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab240ae150 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140b5d20 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab240ade70 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab240671f0 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab140bf410 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.866+0000 7fab0bfff640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 0x7fab10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.870+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab1411ee10 con 0x7fab240cb9b0 2023-11-24T07:57:16.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.870+0000 7fab22ffd640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 0x7fab10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:16.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.870+0000 7fab22ffd640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 0x7fab10068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab2406dcc0 tx=0x7fab18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:16.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:16.874+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab14122030 con 0x7fab240cb9b0 2023-11-24T07:57:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.030+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab2406b460 con 0x7fab240cb9b0 2023-11-24T07:57:17.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.030+0000 7fab0bfff640 1 -- 172.21.15.5:0/4075476099 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab140f4e60 con 0x7fab240cb9b0 2023-11-24T07:57:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 msgr2=0x7fab10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 0x7fab10068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab2406dcc0 tx=0x7fab18008040 comp rx=0 tx=0).stop 2023-11-24T07:57:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 msgr2=0x7fab240abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab140ad040 tx=0x7fab1401ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 shutdown_connections 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fab100664a0 0x7fab10068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab240ce5d0 0x7fab2415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab240cbd90 0x7fab24151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 --2- 172.21.15.5:0/4075476099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab240cb9b0 0x7fab240abf90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 >> 172.21.15.5:0/4075476099 conn(0x7fab240b0cb0 msgr2=0x7fab2415bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 shutdown_connections 2023-11-24T07:57:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.034+0000 7fab29c9c640 1 -- 172.21.15.5:0/4075476099 wait complete. 2023-11-24T07:57:17.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.198+0000 7fa800e9c640 1 Processor -- start 2023-11-24T07:57:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.198+0000 7fa800e9c640 1 -- start start 2023-11-24T07:57:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa800e9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa800e9c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7fc15a710 0x7fa7fc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa800e9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc0ce8d0 con 0x7fa7fc0cbd50 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa800e9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0cca80 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa800e9c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b2710 con 0x7fa7fc15a710 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54968/0 (socket says 172.21.15.5:54968) 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 -- 172.21.15.5:0/2978434992 learned_addr learned my addr 172.21.15.5:0/2978434992 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7f3fff640 1 --2- 172.21.15.5:0/2978434992 >> v2:172.21.15.102:3300/0 conn(0x7fa7fc15a710 0x7fa7fc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 -- 172.21.15.5:0/2978434992 >> v2:172.21.15.102:3300/0 conn(0x7fa7fc15a710 msgr2=0x7fa7fc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/2978434992 >> v2:172.21.15.102:3300/0 conn(0x7fa7fc15a710 0x7fa7fc0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 -- 172.21.15.5:0/2978434992 >> v1:172.21.15.102:6789/0 conn(0x7fa7fc0cbd50 legacy=0x7fa7fc0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.202+0000 7fa7fa59c640 1 -- 172.21.15.5:0/2978434992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc0b29f0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/2978434992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0d0040 tx=0x7fa7ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3099da3a4725b990 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa7f9d9b640 1 -- 172.21.15.5:0/2978434992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0aa430 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa7f9d9b640 1 -- 172.21.15.5:0/2978434992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0aa590 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa7f9d9b640 1 -- 172.21.15.5:0/2978434992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0aa920 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- 172.21.15.5:0/2978434992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 msgr2=0x7fa7fc0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 --2- 172.21.15.5:0/2978434992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0d0040 tx=0x7fa7ec01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- 172.21.15.5:0/2978434992 shutdown_connections 2023-11-24T07:57:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 --2- 172.21.15.5:0/2978434992 >> v2:172.21.15.102:3300/0 conn(0x7fa7fc15a710 0x7fa7fc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 --2- 172.21.15.5:0/2978434992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc0abf90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- 172.21.15.5:0/2978434992 >> 172.21.15.5:0/2978434992 conn(0x7fa7fc0b0cb0 msgr2=0x7fa7fc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- 172.21.15.5:0/2978434992 shutdown_connections 2023-11-24T07:57:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- 172.21.15.5:0/2978434992 wait complete. 2023-11-24T07:57:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 Processor -- start 2023-11-24T07:57:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.206+0000 7fa800e9c640 1 -- start start 2023-11-24T07:57:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 0x7fa7fc143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7fc15a710 0x7fa7fc09a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc143920 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc143650 con 0x7fa7fc0cbd50 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc159950 con 0x7fa7fc15a710 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54972/0 (socket says 172.21.15.5:54972) 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 -- 172.21.15.5:0/1026247997 learned_addr learned my addr 172.21.15.5:0/1026247997 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 0x7fa7fc143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7fad9d640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7fc15a710 0x7fa7fc09a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 -- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7fc15a710 msgr2=0x7fa7fc09a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7fc15a710 0x7fa7fc09a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 -- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 msgr2=0x7fa7fc143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 0x7fa7fc143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 -- 172.21.15.5:0/1026247997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0094d0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 0x7fa7fc143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f3fff640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400d800 tx=0x7fa7e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400b6c0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400b820 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400bbb0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc143b70 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc144130 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc0671f0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.210+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7e400bd10 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.214+0000 7fa7f2ffd640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 0x7fa7dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.214+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7e4084430 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.214+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 0x7fa7dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.214+0000 7fa7fa59c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 0x7fa7dc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ae000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.218+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7e4051780 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.374+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7fc06b460 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.374+0000 7fa7f2ffd640 1 -- 172.21.15.5:0/1026247997 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7e4054da0 con 0x7fa7fc0cdfb0 2023-11-24T07:57:17.381 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 msgr2=0x7fa7dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 0x7fa7dc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ae000 tx=0x7fa7ec0a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 msgr2=0x7fa7fc159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400d800 tx=0x7fa7e400dcc0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 shutdown_connections 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa7dc066470 0x7fa7dc068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7fc15a710 0x7fa7fc09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7fc0cdfb0 0x7fa7fc159410 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 --2- 172.21.15.5:0/1026247997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7fc0cbd50 0x7fa7fc143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 >> 172.21.15.5:0/1026247997 conn(0x7fa7fc0b0cb0 msgr2=0x7fa7fc156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 shutdown_connections 2023-11-24T07:57:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.378+0000 7fa800e9c640 1 -- 172.21.15.5:0/1026247997 wait complete. 2023-11-24T07:57:17.474 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T07:57:17.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 Processor -- start 2023-11-24T07:57:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 -- start start 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f480cead0 0x7f9f480d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f4806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480d2300 con 0x7f9f4815d7b0 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480d17e0 con 0x7f9f480cead0 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f502d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480cefd0 con 0x7f9f480d1eb0 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f480cead0 0x7f9f480d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4e072640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f4815d7b0 0x7f9f480d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42354/0 (socket says 172.21.15.5:42354) 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f480cead0 0x7f9f480d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54978/0 (socket says 172.21.15.5:54978) 2023-11-24T07:57:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 -- 172.21.15.5:0/1413233555 learned_addr learned my addr 172.21.15.5:0/1413233555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4e873640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f4806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 -- 172.21.15.5:0/1413233555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 msgr2=0x7f9f4806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f4806bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 -- 172.21.15.5:0/1413233555 >> v1:172.21.15.5:6789/0 conn(0x7f9f4815d7b0 legacy=0x7f9f480d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.614+0000 7f9f4d871640 1 -- 172.21.15.5:0/1413233555 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480cf2b0 con 0x7f9f480cead0 2023-11-24T07:57:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f4d871640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f480d1970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f3801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e6c00100f6c6f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f4d070640 1 -- 172.21.15.5:0/1413233555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380ab5f0 con 0x7f9f480cead0 2023-11-24T07:57:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f4d070640 1 -- 172.21.15.5:0/1413233555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380ab750 con 0x7f9f480cead0 2023-11-24T07:57:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f4d070640 1 -- 172.21.15.5:0/1413233555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380abae0 con 0x7f9f480cead0 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 -- 172.21.15.5:0/1413233555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 msgr2=0x7f9f480d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f480d1970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009870 tx=0x7f9f3801c3f0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 -- 172.21.15.5:0/1413233555 shutdown_connections 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f4806bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 --2- 172.21.15.5:0/1413233555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f480d1970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 -- 172.21.15.5:0/1413233555 >> 172.21.15.5:0/1413233555 conn(0x7f9f480d33b0 msgr2=0x7f9f480d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 -- 172.21.15.5:0/1413233555 shutdown_connections 2023-11-24T07:57:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.618+0000 7f9f502d6640 1 -- 172.21.15.5:0/1413233555 wait complete. 2023-11-24T07:57:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 Processor -- start 2023-11-24T07:57:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- start start 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f480b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f4815d7b0 0x7f9f481548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48157380 con 0x7f9f480cead0 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480c93e0 con 0x7f9f4815d7b0 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480c96c0 con 0x7f9f480d1eb0 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54988/0 (socket says 172.21.15.5:54988) 2023-11-24T07:57:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 -- 172.21.15.5:0/705507178 learned_addr learned my addr 172.21.15.5:0/705507178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 -- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 msgr2=0x7f9f480b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f480b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 -- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f4815d7b0 msgr2=0x7f9f481548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f4815d7b0 0x7f9f481548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 -- 172.21.15.5:0/705507178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380094d0 con 0x7f9f480cead0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f4e072640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400c430 tx=0x7f9f4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f440074e0 con 0x7f9f480cead0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f44007640 con 0x7f9f480cead0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44004a10 con 0x7f9f480cead0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f480c99a0 con 0x7f9f480cead0 2023-11-24T07:57:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4815a0d0 con 0x7f9f480cead0 2023-11-24T07:57:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.622+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f480c9e50 con 0x7f9f480cead0 2023-11-24T07:57:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.626+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f44004b70 con 0x7f9f480cead0 2023-11-24T07:57:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.626+0000 7f9f3effd640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 0x7f9f2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.626+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f440836a0 con 0x7f9f480cead0 2023-11-24T07:57:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.626+0000 7f9f4d871640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 0x7f9f2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.626+0000 7f9f4d871640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 0x7f9f2c068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af000 tx=0x7f9f38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.630+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f44050b90 con 0x7f9f480cead0 2023-11-24T07:57:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.786+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f480d2300 con 0x7f9f480cead0 2023-11-24T07:57:17.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.786+0000 7f9f3effd640 1 -- 172.21.15.5:0/705507178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f9f480d2300 con 0x7f9f480cead0 2023-11-24T07:57:17.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:17.792 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:17.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 msgr2=0x7f9f2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 0x7f9f2c068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af000 tx=0x7f9f38008040 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 msgr2=0x7f9f48159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400c430 tx=0x7f9f4400c8f0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 shutdown_connections 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9f2c066470 0x7f9f2c068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f4815d7b0 0x7f9f481548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f480d1eb0 0x7f9f480b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 --2- 172.21.15.5:0/705507178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f480cead0 0x7f9f48159b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 >> 172.21.15.5:0/705507178 conn(0x7f9f480d33b0 msgr2=0x7f9f480d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 shutdown_connections 2023-11-24T07:57:17.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.790+0000 7f9f502d6640 1 -- 172.21.15.5:0/705507178 wait complete. 2023-11-24T07:57:17.813 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:17.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.954+0000 7f0238101640 1 Processor -- start 2023-11-24T07:57:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.954+0000 7f0238101640 1 -- start start 2023-11-24T07:57:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0238101640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02300cb9b0 0x7f023006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0238101640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300ce5d0 0x7f023015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0238101640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0230159630 con 0x7f02300cbd90 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0238101640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023015bba0 con 0x7f02300cb9b0 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0238101640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300cdd50 con 0x7f02300ce5d0 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02300cb9b0 0x7f023006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02300cb9b0 0x7f023006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54990/0 (socket says 172.21.15.5:54990) 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 -- 172.21.15.5:0/289293916 learned_addr learned my addr 172.21.15.5:0/289293916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f023669e640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300ce5d0 0x7f023015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 -- 172.21.15.5:0/289293916 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300ce5d0 msgr2=0x7f023015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300ce5d0 0x7f023015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 -- 172.21.15.5:0/289293916 >> v1:172.21.15.102:6789/0 conn(0x7f02300cbd90 legacy=0x7f023015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 -- 172.21.15.5:0/289293916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300cd1d0 con 0x7f02300cb9b0 2023-11-24T07:57:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.958+0000 7f0235e9d640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300cb9b0 0x7f023006e3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f022c009870 tx=0x7f022c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4aedcb5557fc58e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0234e9b640 1 -- 172.21.15.5:0/289293916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0aa650 con 0x7f02300cb9b0 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0234e9b640 1 -- 172.21.15.5:0/289293916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c0aa7b0 con 0x7f02300cb9b0 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0234e9b640 1 -- 172.21.15.5:0/289293916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0aab40 con 0x7f02300cb9b0 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- 172.21.15.5:0/289293916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300cb9b0 msgr2=0x7f023006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300cb9b0 0x7f023006e3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f022c009870 tx=0x7f022c01c510 comp rx=0 tx=0).stop 2023-11-24T07:57:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- 172.21.15.5:0/289293916 shutdown_connections 2023-11-24T07:57:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300ce5d0 0x7f023015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- 172.21.15.5:0/289293916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300cb9b0 0x7f023006e3f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- 172.21.15.5:0/289293916 >> 172.21.15.5:0/289293916 conn(0x7f02300b0cb0 msgr2=0x7f02300b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- 172.21.15.5:0/289293916 shutdown_connections 2023-11-24T07:57:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- 172.21.15.5:0/289293916 wait complete. 2023-11-24T07:57:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 Processor -- start 2023-11-24T07:57:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- start start 2023-11-24T07:57:17.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300cb9b0 0x7f02301538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02300cbd90 0x7f02301564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023009a8c0 con 0x7f02300ce5d0 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023009b110 con 0x7f02300cbd90 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0238101640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023009b3f0 con 0x7f02300cb9b0 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f023669e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f023669e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54996/0 (socket says 172.21.15.5:54996) 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f023669e640 1 -- 172.21.15.5:0/160225798 learned_addr learned my addr 172.21.15.5:0/160225798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f023569c640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02300cbd90 0x7f02301564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.962+0000 7f0235e9d640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300cb9b0 0x7f02301538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 -- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300cb9b0 msgr2=0x7f02301538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300cb9b0 0x7f02301538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 -- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02300cbd90 msgr2=0x7f02301564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02300cbd90 0x7f02301564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 -- 172.21.15.5:0/160225798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0094d0 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f023669e640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0228007e60 tx=0x7f022800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228014420 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280145a0 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228014950 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023009b6d0 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023009adc0 con 0x7f02300ce5d0 2023-11-24T07:57:17.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02300671f0 con 0x7f02300ce5d0 2023-11-24T07:57:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0228014ab0 con 0x7f02300ce5d0 2023-11-24T07:57:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 0x7f0214068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:17.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.966+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0228084680 con 0x7f02300ce5d0 2023-11-24T07:57:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.970+0000 7f0235e9d640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 0x7f0214068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:17.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.970+0000 7f0235e9d640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 0x7f0214068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f022c0ae000 tx=0x7f022c0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:17.970+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0228051ba0 con 0x7f02300ce5d0 2023-11-24T07:57:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.130+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f023006b460 con 0x7f02300ce5d0 2023-11-24T07:57:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.130+0000 7f02267fc640 1 -- 172.21.15.5:0/160225798 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02280551c0 con 0x7f02300ce5d0 2023-11-24T07:57:18.135 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 msgr2=0x7f0214068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 0x7f0214068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f022c0ae000 tx=0x7f022c0b5040 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 msgr2=0x7f02301405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0228007e60 tx=0x7f022800e4b0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 shutdown_connections 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0214066470 0x7f0214068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02300ce5d0 0x7f02301405a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02300cbd90 0x7f02301564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 --2- 172.21.15.5:0/160225798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02300cb9b0 0x7f02301538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 >> 172.21.15.5:0/160225798 conn(0x7f02300b0cb0 msgr2=0x7f023015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 shutdown_connections 2023-11-24T07:57:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.134+0000 7f0238101640 1 -- 172.21.15.5:0/160225798 wait complete. 2023-11-24T07:57:18.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:18.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.298+0000 7f329710f640 1 Processor -- start 2023-11-24T07:57:18.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.298+0000 7f329710f640 1 -- start start 2023-11-24T07:57:18.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.298+0000 7f329710f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f329015a710 0x7f32900abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.298+0000 7f329710f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900b2710 con 0x7f32900cbd50 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f329710f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900b29f0 con 0x7f32900cdfb0 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f329710f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900cca80 con 0x7f329015a710 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f32956ac640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32900cbd50 0x7f32900cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42368/0 (socket says 172.21.15.5:42368) 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f32956ac640 1 -- 172.21.15.5:0/724914923 learned_addr learned my addr 172.21.15.5:0/724914923 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:18.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328ffff640 1 --2- 172.21.15.5:0/724914923 >> v2:172.21.15.102:3300/0 conn(0x7f329015a710 0x7f32900abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215774548 0 0) 0x7f32900b2710 con 0x7f32900cbd50 2023-11-24T07:57:18.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3280003530 con 0x7f32900cbd50 2023-11-24T07:57:18.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062453618 0 0) 0x7f32900b29f0 con 0x7f32900cdfb0 2023-11-24T07:57:18.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32900b2710 con 0x7f32900cdfb0 2023-11-24T07:57:18.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328ffff640 1 -- 172.21.15.5:0/724914923 >> v1:172.21.15.102:6789/0 conn(0x7f32900cdfb0 legacy=0x7f32900ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328ffff640 1 -- 172.21.15.5:0/724914923 >> v1:172.21.15.5:6789/0 conn(0x7f32900cbd50 legacy=0x7f32900cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328ffff640 1 -- 172.21.15.5:0/724914923 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900b2cd0 con 0x7f329015a710 2023-11-24T07:57:18.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.302+0000 7f328ffff640 1 --2- 172.21.15.5:0/724914923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900abf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097c0 tx=0x7f327c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb27088512abf05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0ab670 con 0x7f329015a710 2023-11-24T07:57:18.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c0ab7d0 con 0x7f329015a710 2023-11-24T07:57:18.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f328f7fe640 1 -- 172.21.15.5:0/724914923 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0abb60 con 0x7f329015a710 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- 172.21.15.5:0/724914923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 msgr2=0x7f32900abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 --2- 172.21.15.5:0/724914923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900abf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097c0 tx=0x7f327c01c450 comp rx=0 tx=0).stop 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- 172.21.15.5:0/724914923 shutdown_connections 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 --2- 172.21.15.5:0/724914923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900abf90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- 172.21.15.5:0/724914923 >> 172.21.15.5:0/724914923 conn(0x7f32900b0cb0 msgr2=0x7f32900b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- 172.21.15.5:0/724914923 shutdown_connections 2023-11-24T07:57:18.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- 172.21.15.5:0/724914923 wait complete. 2023-11-24T07:57:18.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 Processor -- start 2023-11-24T07:57:18.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 -- start start 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.306+0000 7f329710f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32900cdfb0 0x7f329015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290164720 con 0x7f32900cbd50 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329015d970 con 0x7f329015a710 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329009c180 con 0x7f32900cdfb0 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54998/0 (socket says 172.21.15.5:54998) 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 -- 172.21.15.5:0/861891461 learned_addr learned my addr 172.21.15.5:0/861891461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 -- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32900cdfb0 msgr2=0x7f329015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32900cdfb0 0x7f329015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 -- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 msgr2=0x7f32900afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 -- 172.21.15.5:0/861891461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009420 con 0x7f32900cbd50 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f3294eab640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f328400c490 tx=0x7f328400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840052d0 con 0x7f32900cbd50 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284005430 con 0x7f32900cbd50 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329009c460 con 0x7f32900cbd50 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284012870 con 0x7f32900cbd50 2023-11-24T07:57:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32901649c0 con 0x7f32900cbd50 2023-11-24T07:57:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32900671f0 con 0x7f32900cbd50 2023-11-24T07:57:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.310+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32840129d0 con 0x7f32900cbd50 2023-11-24T07:57:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.314+0000 7f328d7fa640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 0x7f3274068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.314+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3284083b00 con 0x7f32900cbd50 2023-11-24T07:57:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.314+0000 7f328ffff640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 0x7f3274068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.314+0000 7f328ffff640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 0x7f3274068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f327c0af000 tx=0x7f327c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.318+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3284085e60 con 0x7f32900cbd50 2023-11-24T07:57:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f329006b460 con 0x7f32900cbd50 2023-11-24T07:57:18.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f328d7fa640 1 -- 172.21.15.5:0/861891461 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3284050ee0 con 0x7f32900cbd50 2023-11-24T07:57:18.482 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 msgr2=0x7f3274068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 0x7f3274068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f327c0af000 tx=0x7f327c008040 comp rx=0 tx=0).stop 2023-11-24T07:57:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 msgr2=0x7f3290159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f328400c490 tx=0x7f328400c950 comp rx=0 tx=0).stop 2023-11-24T07:57:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 shutdown_connections 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f3274066470 0x7f3274068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f329015a710 0x7f32900afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32900cdfb0 0x7f329015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 --2- 172.21.15.5:0/861891461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32900cbd50 0x7f3290159f50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 >> 172.21.15.5:0/861891461 conn(0x7f32900b0cb0 msgr2=0x7f3290165740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 shutdown_connections 2023-11-24T07:57:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.478+0000 7f329710f640 1 -- 172.21.15.5:0/861891461 wait complete. 2023-11-24T07:57:18.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:18.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 Processor -- start 2023-11-24T07:57:18.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 -- start start 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecf00ae680 0x7fecf00cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf0072950 con 0x7fecf0070890 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006e2b0 con 0x7fecf0159f00 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf66c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf006c6f0 con 0x7fecf00ae680 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecf00ae680 0x7fecf00cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf4c66640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fecf0070890 0x7fecf0070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42380/0 (socket says 172.21.15.5:42380) 2023-11-24T07:57:18.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecf4c66640 1 -- 172.21.15.5:0/3153525479 learned_addr learned my addr 172.21.15.5:0/3153525479 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:18.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecef7fe640 1 -- 172.21.15.5:0/3153525479 >> v1:172.21.15.102:6789/0 conn(0x7fecf0159f00 legacy=0x7fecf00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecef7fe640 1 -- 172.21.15.5:0/3153525479 >> v1:172.21.15.5:6789/0 conn(0x7fecf0070890 legacy=0x7fecf0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7fecef7fe640 1 -- 172.21.15.5:0/3153525479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf006e550 con 0x7fecf00ae680 2023-11-24T07:57:18.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.646+0000 7feceeffd640 1 -- 172.21.15.5:0/3153525479 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063433373 0 0) 0x7fecf0072950 con 0x7fecf0070890 2023-11-24T07:57:18.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecef7fe640 1 --2- 172.21.15.5:0/3153525479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf00ae680 0x7fecf00cd5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fece400ba50 tx=0x7fece401e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f985721789852 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7feceeffd640 1 -- 172.21.15.5:0/3153525479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40a7950 con 0x7fecf00ae680 2023-11-24T07:57:18.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7feceeffd640 1 -- 172.21.15.5:0/3153525479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece40ab070 con 0x7fecf00ae680 2023-11-24T07:57:18.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7feceeffd640 1 -- 172.21.15.5:0/3153525479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40a7cd0 con 0x7fecf00ae680 2023-11-24T07:57:18.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 -- 172.21.15.5:0/3153525479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf00ae680 msgr2=0x7fecf00cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3153525479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf00ae680 0x7fecf00cd5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fece400ba50 tx=0x7fece401e900 comp rx=0 tx=0).stop 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 -- 172.21.15.5:0/3153525479 shutdown_connections 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3153525479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf00ae680 0x7fecf00cd5b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 -- 172.21.15.5:0/3153525479 >> 172.21.15.5:0/3153525479 conn(0x7fecf00b0cb0 msgr2=0x7fecf00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 -- 172.21.15.5:0/3153525479 shutdown_connections 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.650+0000 7fecf66c9640 1 -- 172.21.15.5:0/3153525479 wait complete. 2023-11-24T07:57:18.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 Processor -- start 2023-11-24T07:57:18.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- start start 2023-11-24T07:57:18.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 0x7fecf01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 0x7fecf0158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015c8f0 con 0x7fecf0070890 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015b850 con 0x7fecf015b290 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015bb30 con 0x7fecf00ae680 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55018/0 (socket says 172.21.15.5:55018) 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 -- 172.21.15.5:0/3059409822 learned_addr learned my addr 172.21.15.5:0/3059409822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecef7fe640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 0x7fecf01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf4c66640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 0x7fecf0158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 -- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 msgr2=0x7fecf01517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 0x7fecf01517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 -- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 msgr2=0x7fecf0158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 0x7fecf0158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 -- 172.21.15.5:0/3059409822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece400b6b0 con 0x7fecf0070890 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf4c66640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 0x7fecf0158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecef7fe640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 0x7fecf01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7feceffff640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fece000c3c0 tx=0x7fece000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00052d0 con 0x7fecf0070890 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0005430 con 0x7fecf0070890 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0003840 con 0x7fecf0070890 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf015be10 con 0x7fecf0070890 2023-11-24T07:57:18.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf015c3d0 con 0x7fecf0070890 2023-11-24T07:57:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.654+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf00671f0 con 0x7fecf0070890 2023-11-24T07:57:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.658+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fece00039a0 con 0x7fecf0070890 2023-11-24T07:57:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.658+0000 7fececff9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 0x7fecdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.658+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fece00833e0 con 0x7fecf0070890 2023-11-24T07:57:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.658+0000 7fecef7fe640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 0x7fecdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.658+0000 7fecef7fe640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 0x7fecdc068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fece40b2000 tx=0x7fece40a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.662+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fece0050850 con 0x7fecf0070890 2023-11-24T07:57:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.818+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecf006b460 con 0x7fecf0070890 2023-11-24T07:57:18.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.818+0000 7fececff9640 1 -- 172.21.15.5:0/3059409822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fece0053e70 con 0x7fecf0070890 2023-11-24T07:57:18.824 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 msgr2=0x7fecdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 0x7fecdc068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fece40b2000 tx=0x7fece40a9070 comp rx=0 tx=0).stop 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 msgr2=0x7fecf01f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fece000c3c0 tx=0x7fece000c880 comp rx=0 tx=0).stop 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 shutdown_connections 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fecdc066470 0x7fecdc068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fecf015b290 0x7fecf0158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fecf00ae680 0x7fecf01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 --2- 172.21.15.5:0/3059409822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf0070890 0x7fecf01f9cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 >> 172.21.15.5:0/3059409822 conn(0x7fecf00b0cb0 msgr2=0x7fecf0070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 shutdown_connections 2023-11-24T07:57:18.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.822+0000 7fecf66c9640 1 -- 172.21.15.5:0/3059409822 wait complete. 2023-11-24T07:57:18.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T07:57:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.982+0000 7f1d9926b640 1 Processor -- start 2023-11-24T07:57:18.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d9926b640 1 -- start start 2023-11-24T07:57:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d9926b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d9926b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940ae7f0 con 0x7f1d94143ae0 2023-11-24T07:57:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d9926b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9406e980 con 0x7f1d9406dfd0 2023-11-24T07:57:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d9926b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94070670 con 0x7f1d940ae3d0 2023-11-24T07:57:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d92ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d94143ae0 0x7f1d940b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42386/0 (socket says 172.21.15.5:42386) 2023-11-24T07:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d92ffd640 1 -- 172.21.15.5:0/4128160242 learned_addr learned my addr 172.21.15.5:0/4128160242 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d937fe640 1 --2- 172.21.15.5:0/4128160242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442263745 0 0) 0x7f1d940ae7f0 con 0x7f1d94143ae0 2023-11-24T07:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d80003530 con 0x7f1d94143ae0 2023-11-24T07:57:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737561760 0 0) 0x7f1d9406e980 con 0x7f1d9406dfd0 2023-11-24T07:57:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d940ae7f0 con 0x7f1d9406dfd0 2023-11-24T07:57:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d937fe640 1 -- 172.21.15.5:0/4128160242 >> v1:172.21.15.102:6789/0 conn(0x7f1d9406dfd0 legacy=0x7f1d940adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d937fe640 1 -- 172.21.15.5:0/4128160242 >> v1:172.21.15.5:6789/0 conn(0x7f1d94143ae0 legacy=0x7f1d940b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.986+0000 7f1d937fe640 1 -- 172.21.15.5:0/4128160242 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94070950 con 0x7f1d940ae3d0 2023-11-24T07:57:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d937fe640 1 --2- 172.21.15.5:0/4128160242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9406e440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009dc0 tx=0x7f1d8c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eefbb8476413a271 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0a5a00 con 0x7f1d940ae3d0 2023-11-24T07:57:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0a5b60 con 0x7f1d940ae3d0 2023-11-24T07:57:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d927fc640 1 -- 172.21.15.5:0/4128160242 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0ad440 con 0x7f1d940ae3d0 2023-11-24T07:57:18.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 -- 172.21.15.5:0/4128160242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 msgr2=0x7f1d9406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 --2- 172.21.15.5:0/4128160242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9406e440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009dc0 tx=0x7f1d8c01c940 comp rx=0 tx=0).stop 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 -- 172.21.15.5:0/4128160242 shutdown_connections 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 --2- 172.21.15.5:0/4128160242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9406e440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 -- 172.21.15.5:0/4128160242 >> 172.21.15.5:0/4128160242 conn(0x7f1d940b0c40 msgr2=0x7f1d940b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 -- 172.21.15.5:0/4128160242 shutdown_connections 2023-11-24T07:57:18.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 -- 172.21.15.5:0/4128160242 wait complete. 2023-11-24T07:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.990+0000 7f1d9926b640 1 Processor -- start 2023-11-24T07:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- start start 2023-11-24T07:57:19.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9413aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 0x7f1d9409b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413ccd0 con 0x7f1d9406dfd0 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413bc30 con 0x7f1d94143ae0 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9413bf10 con 0x7f1d940ae3d0 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:19.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55024/0 (socket says 172.21.15.5:55024) 2023-11-24T07:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 -- 172.21.15.5:0/1469509676 learned_addr learned my addr 172.21.15.5:0/1469509676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d937fe640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 0x7f1d9409b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9413aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 -- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 msgr2=0x7f1d9413aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:19.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9413aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 -- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 msgr2=0x7f1d9409b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 0x7f1d9409b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 -- 172.21.15.5:0/1469509676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009a70 con 0x7f1d9406dfd0 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d937fe640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 0x7f1d9409b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9413aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:19.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d92ffd640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c4d0 tx=0x7f1d8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84005cf0 con 0x7f1d9406dfd0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d84005e50 con 0x7f1d9406dfd0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9413c1f0 con 0x7f1d9406dfd0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84007290 con 0x7f1d9406dfd0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9413c7b0 con 0x7f1d9406dfd0 2023-11-24T07:57:19.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.994+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9404e850 con 0x7f1d9406dfd0 2023-11-24T07:57:19.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.998+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d840073f0 con 0x7f1d9406dfd0 2023-11-24T07:57:19.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.998+0000 7f1d8b7fe640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:19.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.998+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d84083490 con 0x7f1d9406dfd0 2023-11-24T07:57:19.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.998+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:19.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:18.998+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 0x7f1d74068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b37e0 tx=0x7f1d7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:19.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:19.002+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d84050900 con 0x7f1d9406dfd0 2023-11-24T07:57:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:19.214+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f1d9406cc40 con 0x7f1d9406dfd0 2023-11-24T07:57:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.106+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/1469509676 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1d84053f20 con 0x7f1d9406dfd0 2023-11-24T07:57:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 msgr2=0x7f1d74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 0x7f1d74068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b37e0 tx=0x7f1d7c009040 comp rx=0 tx=0).stop 2023-11-24T07:57:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 msgr2=0x7f1d9413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c4d0 tx=0x7f1d8400c990 comp rx=0 tx=0).stop 2023-11-24T07:57:20.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 shutdown_connections 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d94143ae0 0x7f1d9409b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d940ae3d0 0x7f1d9413aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 --2- 172.21.15.5:0/1469509676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d9406dfd0 0x7f1d9413b330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 >> 172.21.15.5:0/1469509676 conn(0x7f1d940b0c40 msgr2=0x7f1d940af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 shutdown_connections 2023-11-24T07:57:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.110+0000 7f1d9926b640 1 -- 172.21.15.5:0/1469509676 wait complete. 2023-11-24T07:57:20.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T07:57:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 Processor -- start 2023-11-24T07:57:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 -- start start 2023-11-24T07:57:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e980b4210 0x7f1e980b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e9815db40 0x7f1e9815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e98147190 con 0x7f1e98146820 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980b4be0 con 0x7f1e980b4210 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e9d3c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98146c00 con 0x7f1e9815db40 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e980b4210 0x7f1e980b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e96ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e98146820 0x7f1e98070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42394/0 (socket says 172.21.15.5:42394) 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e96ffd640 1 -- 172.21.15.5:0/2603692259 learned_addr learned my addr 172.21.15.5:0/2603692259 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e980b4210 0x7f1e980b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55030/0 (socket says 172.21.15.5:55030) 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e977fe640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e9815db40 0x7f1e9815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 -- 172.21.15.5:0/2603692259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e9815db40 msgr2=0x7f1e9815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e9815db40 0x7f1e9815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 -- 172.21.15.5:0/2603692259 >> v1:172.21.15.5:6789/0 conn(0x7f1e98146820 legacy=0x7f1e98070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e8ffff640 1 -- 172.21.15.5:0/2603692259 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9806d030 con 0x7f1e980b4210 2023-11-24T07:57:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.286+0000 7f1e967fc640 1 -- 172.21.15.5:0/2603692259 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147734895 0 0) 0x7f1e98147190 con 0x7f1e98146820 2023-11-24T07:57:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e8ffff640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980b4210 0x7f1e980b46a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097c0 tx=0x7f1e8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa4f7d03e82d4f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e967fc640 1 -- 172.21.15.5:0/2603692259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800ab650 con 0x7f1e980b4210 2023-11-24T07:57:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e967fc640 1 -- 172.21.15.5:0/2603692259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800ab7b0 con 0x7f1e980b4210 2023-11-24T07:57:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e967fc640 1 -- 172.21.15.5:0/2603692259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800abb40 con 0x7f1e980b4210 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/2603692259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980b4210 msgr2=0x7f1e980b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980b4210 0x7f1e980b46a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097c0 tx=0x7f1e8001c450 comp rx=0 tx=0).stop 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/2603692259 shutdown_connections 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e9815db40 0x7f1e9815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/2603692259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e980b4210 0x7f1e980b46a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/2603692259 >> 172.21.15.5:0/2603692259 conn(0x7f1e980b2f10 msgr2=0x7f1e980b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/2603692259 shutdown_connections 2023-11-24T07:57:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/2603692259 wait complete. 2023-11-24T07:57:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.290+0000 7f1e9d3c4640 1 Processor -- start 2023-11-24T07:57:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- start start 2023-11-24T07:57:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 0x7f1e9815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 0x7f1e980d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e981413f0 con 0x7f1e9815db40 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980cd150 con 0x7f1e980b4210 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980cd430 con 0x7f1e98146820 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55040/0 (socket says 172.21.15.5:55040) 2023-11-24T07:57:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 -- 172.21.15.5:0/1604596049 learned_addr learned my addr 172.21.15.5:0/1604596049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e96ffd640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 0x7f1e9815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 -- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 msgr2=0x7f1e980d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e8ffff640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 0x7f1e980d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 0x7f1e980d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 -- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 msgr2=0x7f1e9815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 0x7f1e9815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 -- 172.21.15.5:0/1604596049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009420 con 0x7f1e9815db40 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e96ffd640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 0x7f1e9815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e8ffff640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 0x7f1e980d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e977fe640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e90007e60 tx=0x7f1e9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90014420 con 0x7f1e9815db40 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e900145a0 con 0x7f1e9815db40 2023-11-24T07:57:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90014950 con 0x7f1e9815db40 2023-11-24T07:57:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e980cd710 con 0x7f1e9815db40 2023-11-24T07:57:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9815b730 con 0x7f1e9815db40 2023-11-24T07:57:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.294+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9806bb10 con 0x7f1e9815db40 2023-11-24T07:57:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.298+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e90014ab0 con 0x7f1e9815db40 2023-11-24T07:57:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.298+0000 7f1e8f7fe640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 0x7f1e78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.298+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e900847c0 con 0x7f1e9815db40 2023-11-24T07:57:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.298+0000 7f1e96ffd640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 0x7f1e78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.298+0000 7f1e96ffd640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 0x7f1e78068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e88000f70 tx=0x7f1e88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.302+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e90051c20 con 0x7f1e9815db40 2023-11-24T07:57:20.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.458+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1e9804e850 con 0x7f1e9815db40 2023-11-24T07:57:20.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e8f7fe640 1 -- 172.21.15.5:0/1604596049 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1e90055240 con 0x7f1e9815db40 2023-11-24T07:57:20.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 msgr2=0x7f1e78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 0x7f1e78068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e88000f70 tx=0x7f1e88009040 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 msgr2=0x7f1e980d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e90007e60 tx=0x7f1e9000e4b0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 shutdown_connections 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e78066470 0x7f1e78068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e9815db40 0x7f1e980d0640 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e98146820 0x7f1e980d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 --2- 172.21.15.5:0/1604596049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e980b4210 0x7f1e9815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 >> 172.21.15.5:0/1604596049 conn(0x7f1e980b2f10 msgr2=0x7f1e980b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 shutdown_connections 2023-11-24T07:57:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:20.462+0000 7f1e9d3c4640 1 -- 172.21.15.5:0/1604596049 wait complete. 2023-11-24T07:57:20.487 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T07:57:20.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T07:57:20.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T07:57:20.706 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T07:57:20.706 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:20.707 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:20.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:20.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:20.769 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:20.769 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:20.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:21.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 Processor -- start 2023-11-24T07:57:21.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 -- start start 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f164c0cead0 0x7f164c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0d22c0 con 0x7f164c15d7b0 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0cefd0 con 0x7f164c0d1eb0 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1652abb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0d17e0 con 0x7f164c0cead0 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f164c0cead0 0x7f164c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f164c0cead0 0x7f164c0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55052/0 (socket says 172.21.15.5:55052) 2023-11-24T07:57:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 -- 172.21.15.5:0/1034064645 learned_addr learned my addr 172.21.15.5:0/1034064645 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f1650857640 1 --1- 172.21.15.5:0/1034064645 >> v1:172.21.15.5:6789/0 conn(0x7f164c15d7b0 0x7f164c0d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42398/0 (socket says 172.21.15.5:42398) 2023-11-24T07:57:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 -- 172.21.15.5:0/1034064645 >> v1:172.21.15.102:6789/0 conn(0x7f164c0d1eb0 legacy=0x7f164c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 -- 172.21.15.5:0/1034064645 >> v1:172.21.15.5:6789/0 conn(0x7f164c15d7b0 legacy=0x7f164c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.006+0000 7f164bfff640 1 -- 172.21.15.5:0/1034064645 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0cf2b0 con 0x7f164c0cead0 2023-11-24T07:57:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f164bfff640 1 --2- 172.21.15.5:0/1034064645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c0d1970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04affb6b68affdd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f164b7fe640 1 -- 172.21.15.5:0/1034064645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380ac410 con 0x7f164c0cead0 2023-11-24T07:57:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f164b7fe640 1 -- 172.21.15.5:0/1034064645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380ac570 con 0x7f164c0cead0 2023-11-24T07:57:21.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f164b7fe640 1 -- 172.21.15.5:0/1034064645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380ac900 con 0x7f164c0cead0 2023-11-24T07:57:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 -- 172.21.15.5:0/1034064645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 msgr2=0x7f164c0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 --2- 172.21.15.5:0/1034064645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c0d1970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163801c3b0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 -- 172.21.15.5:0/1034064645 shutdown_connections 2023-11-24T07:57:21.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 --2- 172.21.15.5:0/1034064645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c0d1970 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 -- 172.21.15.5:0/1034064645 >> 172.21.15.5:0/1034064645 conn(0x7f164c0d33b0 msgr2=0x7f164c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 -- 172.21.15.5:0/1034064645 shutdown_connections 2023-11-24T07:57:21.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.010+0000 7f1652abb640 1 -- 172.21.15.5:0/1034064645 wait complete. 2023-11-24T07:57:21.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 Processor -- start 2023-11-24T07:57:21.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 -- start start 2023-11-24T07:57:21.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 0x7f164c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f164c15d7b0 0x7f164c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c15c850 con 0x7f164c0cead0 2023-11-24T07:57:21.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c7080 con 0x7f164c0d1eb0 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c7360 con 0x7f164c15d7b0 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55062/0 (socket says 172.21.15.5:55062) 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 -- 172.21.15.5:0/3601852240 learned_addr learned my addr 172.21.15.5:0/3601852240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f164bfff640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 0x7f164c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1651058640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f164c15d7b0 0x7f164c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 -- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f164c15d7b0 msgr2=0x7f164c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f164c15d7b0 0x7f164c1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 -- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 msgr2=0x7f164c1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 0x7f164c1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 -- 172.21.15.5:0/3601852240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380094d0 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f164bfff640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 0x7f164c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1650857640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f164000c430 tx=0x7f164000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400074e0 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640007640 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640004a10 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.014+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0c7640 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c15c520 con 0x7f164c0cead0 2023-11-24T07:57:21.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c04e850 con 0x7f164c0cead0 2023-11-24T07:57:21.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1640004b70 con 0x7f164c0cead0 2023-11-24T07:57:21.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f16497fa640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 0x7f1630068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1640083890 con 0x7f164c0cead0 2023-11-24T07:57:21.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f164bfff640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 0x7f1630068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.018+0000 7f164bfff640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 0x7f1630068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16380ae000 tx=0x7f1638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.022+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1640050c70 con 0x7f164c0cead0 2023-11-24T07:57:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.182+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f164c0c7af0 con 0x7f164c0cead0 2023-11-24T07:57:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.182+0000 7f16497fa640 1 -- 172.21.15.5:0/3601852240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1640054290 con 0x7f164c0cead0 2023-11-24T07:57:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:21.188 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 msgr2=0x7f1630068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 0x7f1630068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16380ae000 tx=0x7f1638008040 comp rx=0 tx=0).stop 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 msgr2=0x7f164c15bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f164000c430 tx=0x7f164000c8f0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 shutdown_connections 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1630066470 0x7f1630068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f164c15d7b0 0x7f164c1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c0d1eb0 0x7f164c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 --2- 172.21.15.5:0/3601852240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f164c0cead0 0x7f164c15bfe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 >> 172.21.15.5:0/3601852240 conn(0x7f164c0d33b0 msgr2=0x7f164c0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 shutdown_connections 2023-11-24T07:57:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.186+0000 7f1652abb640 1 -- 172.21.15.5:0/3601852240 wait complete. 2023-11-24T07:57:21.209 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:21.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:21.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.350+0000 7f3722c13640 1 Processor -- start 2023-11-24T07:57:21.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.350+0000 7f3722c13640 1 -- start start 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f3722c13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f371c15a710 0x7f371c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f3722c13640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c0b2710 con 0x7f371c0cbd50 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f3722c13640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c0b29f0 con 0x7f371c0cdfb0 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f3722c13640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c0cca80 con 0x7f371c15a710 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f37211b0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f371c0cbd50 0x7f371c0cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42406/0 (socket says 172.21.15.5:42406) 2023-11-24T07:57:21.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f37211b0640 1 -- 172.21.15.5:0/1392699028 learned_addr learned my addr 172.21.15.5:0/1392699028 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:21.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 --2- 172.21.15.5:0/1392699028 >> v2:172.21.15.102:3300/0 conn(0x7f371c15a710 0x7f371c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072087097 0 0) 0x7f371c0b2710 con 0x7f371c0cbd50 2023-11-24T07:57:21.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f370c003530 con 0x7f371c0cbd50 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083545567 0 0) 0x7f370c003530 con 0x7f371c0cbd50 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 >> v2:172.21.15.102:3300/0 conn(0x7f371c15a710 msgr2=0x7f371c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 --2- 172.21.15.5:0/1392699028 >> v2:172.21.15.102:3300/0 conn(0x7f371c15a710 0x7f371c0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 >> v1:172.21.15.102:6789/0 conn(0x7f371c0cdfb0 legacy=0x7f371c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0b2cd0 con 0x7f371c0cbd50 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f3714001a00 con 0x7f371c0cbd50 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 >> v1:172.21.15.5:6789/0 conn(0x7f371c0cbd50 legacy=0x7f371c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f370c0039d0 0x7f370c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f370c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f370c005190 0x7f370c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0cca80 con 0x7f370c0047d0 2023-11-24T07:57:21.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00c090 con 0x7f370c0039d0 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00c250 con 0x7f370c005190 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f370c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f37209af640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f370c0039d0 0x7f370c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f37211b0640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f370c005190 0x7f370c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 -- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f370c005190 msgr2=0x7f370c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f370c005190 0x7f370c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 -- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f370c0039d0 msgr2=0x7f370c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f370c0039d0 0x7f370c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f371bfff640 1 -- 172.21.15.5:0/1392699028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c003530 con 0x7f370c0047d0 2023-11-24T07:57:21.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.354+0000 7f37211b0640 1 -- 172.21.15.5:0/1392699028 reap_dead start 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f371bfff640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f370c004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3708009ab0 tx=0x7f370801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2908557aa027124c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080a55e0 con 0x7f370c0047d0 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37080a5740 con 0x7f370c0047d0 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f371b7fe640 1 -- 172.21.15.5:0/1392699028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080a5af0 con 0x7f370c0047d0 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 -- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 msgr2=0x7f370c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f370c004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3708009ab0 tx=0x7f370801c9f0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 -- 172.21.15.5:0/1392699028 shutdown_connections 2023-11-24T07:57:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 --2- 172.21.15.5:0/1392699028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f370c004c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 -- 172.21.15.5:0/1392699028 >> 172.21.15.5:0/1392699028 conn(0x7f371c0b0cb0 msgr2=0x7f371c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 -- 172.21.15.5:0/1392699028 shutdown_connections 2023-11-24T07:57:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 -- 172.21.15.5:0/1392699028 wait complete. 2023-11-24T07:57:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.358+0000 7f3722c13640 1 Processor -- start 2023-11-24T07:57:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- start start 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c099b10 0x7f371c154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c156230 0x7f371c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c155da0 con 0x7f370c0047d0 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c155190 con 0x7f371c099b10 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c155470 con 0x7f371c156230 2023-11-24T07:57:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55076/0 (socket says 172.21.15.5:55076) 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 -- 172.21.15.5:0/465137186 learned_addr learned my addr 172.21.15.5:0/465137186 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37211b0640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c156230 0x7f371c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f371bfff640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c099b10 0x7f371c154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 -- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c156230 msgr2=0x7f371c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c156230 0x7f371c15ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 -- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c099b10 msgr2=0x7f371c154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c099b10 0x7f371c154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 -- 172.21.15.5:0/465137186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c155750 con 0x7f370c0047d0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37209af640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f371000e480 tx=0x7f371000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37100052e0 con 0x7f370c0047d0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3710005440 con 0x7f370c0047d0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c155a30 con 0x7f370c0047d0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710003840 con 0x7f370c0047d0 2023-11-24T07:57:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c154d80 con 0x7f370c0047d0 2023-11-24T07:57:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.362+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c0671f0 con 0x7f370c0047d0 2023-11-24T07:57:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.366+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37100039a0 con 0x7f370c0047d0 2023-11-24T07:57:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.366+0000 7f37197fa640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.366+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3710083bf0 con 0x7f370c0047d0 2023-11-24T07:57:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.366+0000 7f371bfff640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.366+0000 7f371bfff640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 0x7f3700068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37080af000 tx=0x7f37080046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.370+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3710051060 con 0x7f370c0047d0 2023-11-24T07:57:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.530+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f371c06b460 con 0x7f370c0047d0 2023-11-24T07:57:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.530+0000 7f37197fa640 1 -- 172.21.15.5:0/465137186 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3710054680 con 0x7f370c0047d0 2023-11-24T07:57:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 msgr2=0x7f3700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 0x7f3700068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37080af000 tx=0x7f37080046d0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 msgr2=0x7f371c1499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f371000e480 tx=0x7f371000e940 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 shutdown_connections 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f37000664a0 0x7f3700068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c156230 0x7f371c15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c099b10 0x7f371c154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 --2- 172.21.15.5:0/465137186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f370c0047d0 0x7f371c1499e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 >> 172.21.15.5:0/465137186 conn(0x7f371c0b0cb0 msgr2=0x7f371c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 shutdown_connections 2023-11-24T07:57:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.534+0000 7f3722c13640 1 -- 172.21.15.5:0/465137186 wait complete. 2023-11-24T07:57:21.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:21.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.698+0000 7f76e8279640 1 Processor -- start 2023-11-24T07:57:21.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.698+0000 7f76e8279640 1 -- start start 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e8279640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76e00b2870 0x7f76e00b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e8279640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0161290 con 0x7f76e006afc0 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e8279640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0161550 con 0x7f76e00b07a0 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e8279640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00b0b80 con 0x7f76e00b2870 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e6816640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f76e006afc0 0x7f76e00cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42422/0 (socket says 172.21.15.5:42422) 2023-11-24T07:57:21.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e6816640 1 -- 172.21.15.5:0/1558540786 learned_addr learned my addr 172.21.15.5:0/1558540786 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> v2:172.21.15.102:3300/0 conn(0x7f76e00b2870 0x7f76e00b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436871564 0 0) 0x7f76e0161290 con 0x7f76e006afc0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc003530 con 0x7f76e006afc0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89650376 0 0) 0x7f76e0161550 con 0x7f76e00b07a0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e0161290 con 0x7f76e00b07a0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306496378 0 0) 0x7f76cc003530 con 0x7f76e006afc0 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 >> v2:172.21.15.102:3300/0 conn(0x7f76e00b2870 msgr2=0x7f76e00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 --2- 172.21.15.5:0/1558540786 >> v2:172.21.15.102:3300/0 conn(0x7f76e00b2870 0x7f76e00b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 >> v1:172.21.15.102:6789/0 conn(0x7f76e00b07a0 legacy=0x7f76e01619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00c65a0 con 0x7f76e006afc0 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f76d8001a00 con 0x7f76e006afc0 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> v2:172.21.15.102:3300/0 conn(0x7f76e00b2870 0x7f76e00b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 >> v1:172.21.15.5:6789/0 conn(0x7f76e006afc0 legacy=0x7f76e00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76cc003b60 0x7f76cc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76cc005190 0x7f76cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc00c060 con 0x7f76cc0047d0 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc00c1a0 con 0x7f76cc003b60 2023-11-24T07:57:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc00c360 con 0x7f76cc005190 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e6015640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76cc003b60 0x7f76cc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e6816640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76cc005190 0x7f76cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 -- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76cc005190 msgr2=0x7f76cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76cc005190 0x7f76cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 -- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76cc003b60 msgr2=0x7f76cc003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76cc003b60 0x7f76cc003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e5814640 1 -- 172.21.15.5:0/1558540786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc003530 con 0x7f76cc0047d0 2023-11-24T07:57:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.702+0000 7f76e6816640 1 -- 172.21.15.5:0/1558540786 reap_dead start 2023-11-24T07:57:21.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e5814640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76cc004c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009c80 tx=0x7f76d001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b59ea180ac9a94c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00a5890 con 0x7f76cc0047d0 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00a59f0 con 0x7f76cc0047d0 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e5013640 1 -- 172.21.15.5:0/1558540786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00a5de0 con 0x7f76cc0047d0 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 -- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 msgr2=0x7f76cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76cc004c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009c80 tx=0x7f76d001cbd0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 -- 172.21.15.5:0/1558540786 shutdown_connections 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 --2- 172.21.15.5:0/1558540786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76cc004c50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 -- 172.21.15.5:0/1558540786 >> 172.21.15.5:0/1558540786 conn(0x7f76e00b1d50 msgr2=0x7f76e00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 -- 172.21.15.5:0/1558540786 shutdown_connections 2023-11-24T07:57:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.706+0000 7f76e8279640 1 -- 172.21.15.5:0/1558540786 wait complete. 2023-11-24T07:57:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 Processor -- start 2023-11-24T07:57:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- start start 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76e0155c50 0x7f76e00af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76e00ce890 0x7f76e00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00cf280 con 0x7f76cc0047d0 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e015e5a0 con 0x7f76e0155c50 2023-11-24T07:57:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e015e7f0 con 0x7f76e00ce890 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55090/0 (socket says 172.21.15.5:55090) 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 -- 172.21.15.5:0/8643650 learned_addr learned my addr 172.21.15.5:0/8643650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6816640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76e00ce890 0x7f76e00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e5814640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76e0155c50 0x7f76e00af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 -- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76e00ce890 msgr2=0x7f76e00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76e00ce890 0x7f76e00ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 -- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76e0155c50 msgr2=0x7f76e00af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76e0155c50 0x7f76e00af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 -- 172.21.15.5:0/8643650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e015ead0 con 0x7f76cc0047d0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e6015640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0114c0 tx=0x7f76dc011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc006bf0 con 0x7f76cc0047d0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc006d70 con 0x7f76cc0047d0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc007290 con 0x7f76cc0047d0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e015edb0 con 0x7f76cc0047d0 2023-11-24T07:57:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e015f370 con 0x7f76cc0047d0 2023-11-24T07:57:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.710+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e004e850 con 0x7f76cc0047d0 2023-11-24T07:57:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.714+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76dc0073f0 con 0x7f76cc0047d0 2023-11-24T07:57:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.714+0000 7f76d6ffd640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 0x7f76c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.714+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76dc086c40 con 0x7f76cc0047d0 2023-11-24T07:57:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.714+0000 7f76e5814640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 0x7f76c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.714+0000 7f76e5814640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 0x7f76c4068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76d00af000 tx=0x7f76d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.718+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76dc054020 con 0x7f76cc0047d0 2023-11-24T07:57:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76e015d390 con 0x7f76cc0047d0 2023-11-24T07:57:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76d6ffd640 1 -- 172.21.15.5:0/8643650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76dc01c310 con 0x7f76cc0047d0 2023-11-24T07:57:21.878 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 msgr2=0x7f76c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 0x7f76c4068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76d00af000 tx=0x7f76d0008040 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 msgr2=0x7f76e0154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0114c0 tx=0x7f76dc011980 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 shutdown_connections 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f76c4066470 0x7f76c4068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76e00ce890 0x7f76e00ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76e0155c50 0x7f76e00af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 --2- 172.21.15.5:0/8643650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76cc0047d0 0x7f76e0154990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 >> 172.21.15.5:0/8643650 conn(0x7f76e00b1d50 msgr2=0x7f76e00b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 shutdown_connections 2023-11-24T07:57:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:21.874+0000 7f76e8279640 1 -- 172.21.15.5:0/8643650 wait complete. 2023-11-24T07:57:21.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 Processor -- start 2023-11-24T07:57:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 -- start start 2023-11-24T07:57:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fba78146820 0x7fba78070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba780b4210 0x7fba780b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780b4be0 con 0x7fba780b4210 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba78147190 con 0x7fba78146820 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba80091640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7806d030 con 0x7fba78161180 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba7d62c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba780b4210 0x7fba780b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba7d62c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba780b4210 0x7fba780b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55106/0 (socket says 172.21.15.5:55106) 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba7d62c640 1 -- 172.21.15.5:0/364261322 learned_addr learned my addr 172.21.15.5:0/364261322 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba7e62e640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.042+0000 7fba7de2d640 1 --2- 172.21.15.5:0/364261322 >> v2:172.21.15.102:3300/0 conn(0x7fba78146820 0x7fba78070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 -- 172.21.15.5:0/364261322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 msgr2=0x7fba781615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 -- 172.21.15.5:0/364261322 >> v2:172.21.15.102:3300/0 conn(0x7fba78146820 msgr2=0x7fba78070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 --2- 172.21.15.5:0/364261322 >> v2:172.21.15.102:3300/0 conn(0x7fba78146820 0x7fba78070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 -- 172.21.15.5:0/364261322 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78146c00 con 0x7fba780b4210 2023-11-24T07:57:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7d62c640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba780b46a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba7806e450 tx=0x7fba6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2054664208b9f98a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7ce2b640 1 -- 172.21.15.5:0/364261322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680aa5f0 con 0x7fba780b4210 2023-11-24T07:57:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7ce2b640 1 -- 172.21.15.5:0/364261322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba680aa750 con 0x7fba780b4210 2023-11-24T07:57:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba7ce2b640 1 -- 172.21.15.5:0/364261322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680aaae0 con 0x7fba780b4210 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba80091640 1 -- 172.21.15.5:0/364261322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 msgr2=0x7fba780b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.046+0000 7fba80091640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba780b46a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba7806e450 tx=0x7fba6801c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- 172.21.15.5:0/364261322 shutdown_connections 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- 172.21.15.5:0/364261322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba780b46a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- 172.21.15.5:0/364261322 >> v2:172.21.15.102:3300/0 conn(0x7fba78146820 0x7fba78070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- 172.21.15.5:0/364261322 >> 172.21.15.5:0/364261322 conn(0x7fba780b2f10 msgr2=0x7fba780b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- 172.21.15.5:0/364261322 shutdown_connections 2023-11-24T07:57:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- 172.21.15.5:0/364261322 wait complete. 2023-11-24T07:57:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 Processor -- start 2023-11-24T07:57:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- start start 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba78146820 0x7fba781529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781fa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78156630 con 0x7fba780b4210 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78156910 con 0x7fba78146820 2023-11-24T07:57:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba80091640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78156bf0 con 0x7fba78161180 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55114/0 (socket says 172.21.15.5:55114) 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 -- 172.21.15.5:0/1755339012 learned_addr learned my addr 172.21.15.5:0/1755339012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7d62c640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba78146820 0x7fba781529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7e62e640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781fa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 -- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 msgr2=0x7fba781fa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781fa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 -- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba78146820 msgr2=0x7fba781529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba78146820 0x7fba781529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.050+0000 7fba7de2d640 1 -- 172.21.15.5:0/1755339012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680094d0 con 0x7fba780b4210 2023-11-24T07:57:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba7de2d640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba7400e8b0 tx=0x7fba7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400c940 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400caa0 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba78156ed0 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400ce30 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba78156200 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba781576d0 con 0x7fba780b4210 2023-11-24T07:57:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba74013470 con 0x7fba780b4210 2023-11-24T07:57:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 0x7fba5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba74083ff0 con 0x7fba780b4210 2023-11-24T07:57:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.054+0000 7fba7d62c640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 0x7fba5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.058+0000 7fba7d62c640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 0x7fba5c068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba680ae000 tx=0x7fba680b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.058+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba740b5280 con 0x7fba780b4210 2023-11-24T07:57:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.218+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba7804e850 con 0x7fba780b4210 2023-11-24T07:57:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.218+0000 7fba6e7fc640 1 -- 172.21.15.5:0/1755339012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba74017020 con 0x7fba780b4210 2023-11-24T07:57:22.224 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 msgr2=0x7fba5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 0x7fba5c068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba680ae000 tx=0x7fba680b5040 comp rx=0 tx=0).stop 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 msgr2=0x7fba78155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba7400e8b0 tx=0x7fba7400ed70 comp rx=0 tx=0).stop 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 shutdown_connections 2023-11-24T07:57:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fba5c066470 0x7fba5c068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba78161180 0x7fba781fa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba78146820 0x7fba781529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 --2- 172.21.15.5:0/1755339012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba780b4210 0x7fba78155cc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 >> 172.21.15.5:0/1755339012 conn(0x7fba780b2f10 msgr2=0x7fba7815ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 shutdown_connections 2023-11-24T07:57:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.222+0000 7fba80091640 1 -- 172.21.15.5:0/1755339012 wait complete. 2023-11-24T07:57:22.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 Processor -- start 2023-11-24T07:57:22.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 -- start start 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6470146820 0x7f6470070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f647015eb50 0x7f64700b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6470147190 con 0x7f64700b4210 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700b4be0 con 0x7f6470146820 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6477935640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6470146c00 con 0x7f647015eb50 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6470146820 0x7f6470070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6470146820 0x7f6470070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55126/0 (socket says 172.21.15.5:55126) 2023-11-24T07:57:22.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 -- 172.21.15.5:0/3553629034 learned_addr learned my addr 172.21.15.5:0/3553629034 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6475ed2640 1 --2- 172.21.15.5:0/3553629034 >> v2:172.21.15.102:3300/0 conn(0x7f647015eb50 0x7f64700b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 -- 172.21.15.5:0/3553629034 >> v2:172.21.15.102:3300/0 conn(0x7f647015eb50 msgr2=0x7f64700b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 --2- 172.21.15.5:0/3553629034 >> v2:172.21.15.102:3300/0 conn(0x7f647015eb50 0x7f64700b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 -- 172.21.15.5:0/3553629034 >> v1:172.21.15.5:6789/0 conn(0x7f64700b4210 legacy=0x7f6470161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f64756d1640 1 -- 172.21.15.5:0/3553629034 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647006d030 con 0x7f6470146820 2023-11-24T07:57:22.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.386+0000 7f6467fff640 1 -- 172.21.15.5:0/3553629034 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560431213 0 0) 0x7f6470147190 con 0x7f64700b4210 2023-11-24T07:57:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f64756d1640 1 --2- 172.21.15.5:0/3553629034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6470146820 0x7f6470070a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f64700d22d0 tx=0x7f646c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958986209965cbd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6467fff640 1 -- 172.21.15.5:0/3553629034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ab5f0 con 0x7f6470146820 2023-11-24T07:57:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6467fff640 1 -- 172.21.15.5:0/3553629034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0ab750 con 0x7f6470146820 2023-11-24T07:57:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6467fff640 1 -- 172.21.15.5:0/3553629034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0abae0 con 0x7f6470146820 2023-11-24T07:57:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 -- 172.21.15.5:0/3553629034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6470146820 msgr2=0x7f6470070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 --2- 172.21.15.5:0/3553629034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6470146820 0x7f6470070a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f64700d22d0 tx=0x7f646c01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 -- 172.21.15.5:0/3553629034 shutdown_connections 2023-11-24T07:57:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 --2- 172.21.15.5:0/3553629034 >> v2:172.21.15.102:3300/0 conn(0x7f647015eb50 0x7f64700b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 --2- 172.21.15.5:0/3553629034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6470146820 0x7f6470070a50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 -- 172.21.15.5:0/3553629034 >> 172.21.15.5:0/3553629034 conn(0x7f64700b2f10 msgr2=0x7f64700b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 -- 172.21.15.5:0/3553629034 shutdown_connections 2023-11-24T07:57:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.390+0000 7f6477935640 1 -- 172.21.15.5:0/3553629034 wait complete. 2023-11-24T07:57:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 Processor -- start 2023-11-24T07:57:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- start start 2023-11-24T07:57:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6470146820 0x7f6470162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647015eb50 0x7f647013d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647013d070 con 0x7f64700b4210 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700b1000 con 0x7f647015eb50 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64700b12e0 con 0x7f6470146820 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55134/0 (socket says 172.21.15.5:55134) 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 -- 172.21.15.5:0/2474657312 learned_addr learned my addr 172.21.15.5:0/2474657312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6474ed0640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6470146820 0x7f6470162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6475ed2640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647015eb50 0x7f647013d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 -- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6470146820 msgr2=0x7f6470162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6470146820 0x7f6470162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 -- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647015eb50 msgr2=0x7f647013d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647015eb50 0x7f647013d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 -- 172.21.15.5:0/2474657312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094d0 con 0x7f64700b4210 2023-11-24T07:57:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f64756d1640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f646c0190e0 tx=0x7f646c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0be5f0 con 0x7f64700b4210 2023-11-24T07:57:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0be750 con 0x7f64700b4210 2023-11-24T07:57:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0beb00 con 0x7f64700b4210 2023-11-24T07:57:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700b15c0 con 0x7f64700b4210 2023-11-24T07:57:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647015ca70 con 0x7f64700b4210 2023-11-24T07:57:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.394+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647004e850 con 0x7f64700b4210 2023-11-24T07:57:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.398+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f646c0b43f0 con 0x7f64700b4210 2023-11-24T07:57:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.398+0000 7f6465ffb640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 0x7f6454068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.398+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f646c0a8050 con 0x7f64700b4210 2023-11-24T07:57:22.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.398+0000 7f6474ed0640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 0x7f6454068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.398+0000 7f6474ed0640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 0x7f6454068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6460000f70 tx=0x7f6460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.402+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f646c0ebed0 con 0x7f64700b4210 2023-11-24T07:57:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64700b1a70 con 0x7f64700b4210 2023-11-24T07:57:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6465ffb640 1 -- 172.21.15.5:0/2474657312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f646c0ef4f0 con 0x7f64700b4210 2023-11-24T07:57:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 msgr2=0x7f6454068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 0x7f6454068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6460000f70 tx=0x7f6460009040 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 msgr2=0x7f647015c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f646c0190e0 tx=0x7f646c01ad10 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 shutdown_connections 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6454066470 0x7f6454068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647015eb50 0x7f647013d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6470146820 0x7f6470162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 --2- 172.21.15.5:0/2474657312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64700b4210 0x7f647015c530 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 >> 172.21.15.5:0/2474657312 conn(0x7f64700b2f10 msgr2=0x7f6470160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 shutdown_connections 2023-11-24T07:57:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.570+0000 7f6477935640 1 -- 172.21.15.5:0/2474657312 wait complete. 2023-11-24T07:57:22.596 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T07:57:22.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:22.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T07:57:22.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:57:22.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:22.633 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T07:57:22.689 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:22.690 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:22.700 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:22.700 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:22.756 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:22.756 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:22.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.950+0000 7f1e4050f640 1 Processor -- start 2023-11-24T07:57:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.950+0000 7f1e4050f640 1 -- start start 2023-11-24T07:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e4050f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e3806dfd0 0x7f1e3806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e4050f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e380adcc0 0x7f1e380ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e4050f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3806e980 con 0x7f1e38143ae0 2023-11-24T07:57:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e4050f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e38070670 con 0x7f1e3806dfd0 2023-11-24T07:57:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e4050f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38070950 con 0x7f1e380adcc0 2023-11-24T07:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3e2ab640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e38143ae0 0x7f1e380b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42438/0 (socket says 172.21.15.5:42438) 2023-11-24T07:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3e2ab640 1 -- 172.21.15.5:0/2527511735 learned_addr learned my addr 172.21.15.5:0/2527511735 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/2527511735 >> v2:172.21.15.5:3300/0 conn(0x7f1e3806dfd0 0x7f1e3806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3eaac640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e380adcc0 0x7f1e380ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3d2a9640 1 -- 172.21.15.5:0/2527511735 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031102738 0 0) 0x7f1e3806e980 con 0x7f1e38143ae0 2023-11-24T07:57:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3daaa640 1 -- 172.21.15.5:0/2527511735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e380adcc0 msgr2=0x7f1e380ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e380adcc0 0x7f1e380ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3daaa640 1 -- 172.21.15.5:0/2527511735 >> v1:172.21.15.5:6789/0 conn(0x7f1e38143ae0 legacy=0x7f1e380b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.954+0000 7f1e3daaa640 1 -- 172.21.15.5:0/2527511735 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38070c30 con 0x7f1e3806dfd0 2023-11-24T07:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3806dfd0 0x7f1e3806e440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e280097c0 tx=0x7f1e2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c191e3ef9fa206 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e3d2a9640 1 -- 172.21.15.5:0/2527511735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280ab650 con 0x7f1e3806dfd0 2023-11-24T07:57:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e3d2a9640 1 -- 172.21.15.5:0/2527511735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e280ab7b0 con 0x7f1e3806dfd0 2023-11-24T07:57:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e3d2a9640 1 -- 172.21.15.5:0/2527511735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280abb40 con 0x7f1e3806dfd0 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- 172.21.15.5:0/2527511735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3806dfd0 msgr2=0x7f1e3806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3806dfd0 0x7f1e3806e440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e280097c0 tx=0x7f1e2801c450 comp rx=0 tx=0).stop 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- 172.21.15.5:0/2527511735 shutdown_connections 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e380adcc0 0x7f1e380ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- 172.21.15.5:0/2527511735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e3806dfd0 0x7f1e3806e440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- 172.21.15.5:0/2527511735 >> 172.21.15.5:0/2527511735 conn(0x7f1e380b0c40 msgr2=0x7f1e380b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- 172.21.15.5:0/2527511735 shutdown_connections 2023-11-24T07:57:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- 172.21.15.5:0/2527511735 wait complete. 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 Processor -- start 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- start start 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 0x7f1e38137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 0x7f1e38139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38158660 con 0x7f1e380adcc0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3813a0b0 con 0x7f1e3806dfd0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e4050f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3813f8d0 con 0x7f1e38143ae0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.958+0000 7f1e3daaa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55156/0 (socket says 172.21.15.5:55156) 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 -- 172.21.15.5:0/687944722 learned_addr learned my addr 172.21.15.5:0/687944722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3eaac640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 0x7f1e38139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3e2ab640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 0x7f1e38137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 -- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 msgr2=0x7f1e38139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 0x7f1e38139b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 -- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 msgr2=0x7f1e38137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 0x7f1e38137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 -- 172.21.15.5:0/687944722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009420 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3eaac640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 0x7f1e38139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3e2ab640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 0x7f1e38137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e3daaa640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1e280ad040 tx=0x7f1e2801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280b4730 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e280b4890 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3813f030 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280b4c40 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3813f5f0 con 0x7f1e380adcc0 2023-11-24T07:57:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3804e850 con 0x7f1e380adcc0 2023-11-24T07:57:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e280c63b0 con 0x7f1e380adcc0 2023-11-24T07:57:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.962+0000 7f1e2effd640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 0x7f1e1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.966+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e281205c0 con 0x7f1e380adcc0 2023-11-24T07:57:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.966+0000 7f1e3e2ab640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 0x7f1e1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.966+0000 7f1e3e2ab640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 0x7f1e1c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e34007fd0 tx=0x7f1e34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:22.966+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e280eda30 con 0x7f1e380adcc0 2023-11-24T07:57:23.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.126+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e3806cc40 con 0x7f1e380adcc0 2023-11-24T07:57:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e2effd640 1 -- 172.21.15.5:0/687944722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1e280f1050 con 0x7f1e380adcc0 2023-11-24T07:57:23.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 msgr2=0x7f1e1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 0x7f1e1c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e34007fd0 tx=0x7f1e34009040 comp rx=0 tx=0).stop 2023-11-24T07:57:23.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 msgr2=0x7f1e3813e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1e280ad040 tx=0x7f1e2801ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 shutdown_connections 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1e1c066470 0x7f1e1c068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e38143ae0 0x7f1e38139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e380adcc0 0x7f1e3813e9a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 --2- 172.21.15.5:0/687944722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3806dfd0 0x7f1e38137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 >> 172.21.15.5:0/687944722 conn(0x7f1e380b0c40 msgr2=0x7f1e380ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 shutdown_connections 2023-11-24T07:57:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.130+0000 7f1e4050f640 1 -- 172.21.15.5:0/687944722 wait complete. 2023-11-24T07:57:23.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:23.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:23.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 Processor -- start 2023-11-24T07:57:23.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 -- start start 2023-11-24T07:57:23.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f2415d8f0 0x7f6f2415e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f240d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2415ecc0 con 0x7f6f240ced30 2023-11-24T07:57:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240d4420 con 0x7f6f2415d8f0 2023-11-24T07:57:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f29301640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240cdfb0 con 0x7f6f240d0510 2023-11-24T07:57:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f227fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f240ced30 0x7f6f240cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42452/0 (socket says 172.21.15.5:42452) 2023-11-24T07:57:23.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f227fc640 1 -- 172.21.15.5:0/3254665221 learned_addr learned my addr 172.21.15.5:0/3254665221 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:23.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f237fe640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f240d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f22ffd640 1 --2- 172.21.15.5:0/3254665221 >> v2:172.21.15.102:3300/0 conn(0x7f6f2415d8f0 0x7f6f2415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243369990 0 0) 0x7f6f2415ecc0 con 0x7f6f240ced30 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c003530 con 0x7f6f240ced30 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1524609337 0 0) 0x7f6f0c003530 con 0x7f6f240ced30 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 msgr2=0x7f6f240d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f240d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 >> v2:172.21.15.102:3300/0 conn(0x7f6f2415d8f0 msgr2=0x7f6f2415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 --2- 172.21.15.5:0/3254665221 >> v2:172.21.15.102:3300/0 conn(0x7f6f2415d8f0 0x7f6f2415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.298+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240d4140 con 0x7f6f240ced30 2023-11-24T07:57:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f6f18001680 con 0x7f6f240ced30 2023-11-24T07:57:23.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 >> v1:172.21.15.5:6789/0 conn(0x7f6f240ced30 legacy=0x7f6f240cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f0c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f0c003f00 0x7f6f0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c004d10 0x7f6f0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240d4420 con 0x7f6f0c004d10 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240cdfb0 con 0x7f6f0c003f00 2023-11-24T07:57:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c00b990 con 0x7f6f240d0510 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c004d10 0x7f6f0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f22ffd640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f0c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f227fc640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f0c003f00 0x7f6f0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 -- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 msgr2=0x7f6f0c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f240d0510 0x7f6f0c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 -- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f0c003f00 msgr2=0x7f6f0c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f0c003f00 0x7f6f0c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 -- 172.21.15.5:0/3254665221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c003530 con 0x7f6f0c004d10 2023-11-24T07:57:23.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f227fc640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f0c003f00 0x7f6f0c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f237fe640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c004d10 0x7f6f0c005190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009f90 tx=0x7f6f1c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d7bae23efea887 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0a5c30 con 0x7f6f0c004d10 2023-11-24T07:57:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00f040 con 0x7f6f0c004d10 2023-11-24T07:57:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.302+0000 7f6f21ffb640 1 -- 172.21.15.5:0/3254665221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0ad440 con 0x7f6f0c004d10 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- 172.21.15.5:0/3254665221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c004d10 msgr2=0x7f6f0c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 --2- 172.21.15.5:0/3254665221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f0c004d10 0x7f6f0c005190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009f90 tx=0x7f6f1c01cbc0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f237fe640 1 -- 172.21.15.5:0/3254665221 reap_dead start 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- 172.21.15.5:0/3254665221 shutdown_connections 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- 172.21.15.5:0/3254665221 >> 172.21.15.5:0/3254665221 conn(0x7f6f2409c750 msgr2=0x7f6f240d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- 172.21.15.5:0/3254665221 shutdown_connections 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- 172.21.15.5:0/3254665221 wait complete. 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 Processor -- start 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- start start 2023-11-24T07:57:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 0x7f6f2414b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f241f34e0 0x7f6f241f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f24159c30 con 0x7f6f240b1000 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f241f4210 con 0x7f6f240b0c20 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.306+0000 7f6f29301640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f24159300 con 0x7f6f241f34e0 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 0x7f6f2414b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55164/0 (socket says 172.21.15.5:55164) 2023-11-24T07:57:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 0x7f6f2414b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:36370/0 (socket says 172.21.15.5:36370) 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 -- 172.21.15.5:0/943740427 learned_addr learned my addr 172.21.15.5:0/943740427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f237fe640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f241f34e0 0x7f6f241f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 -- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f241f34e0 msgr2=0x7f6f241f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f241f34e0 0x7f6f241f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 -- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 msgr2=0x7f6f2414b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 0x7f6f2414b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 -- 172.21.15.5:0/943740427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f241595e0 con 0x7f6f240b1000 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f227fc640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800eb20 tx=0x7f6f1800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800c8d0 con 0x7f6f240b1000 2023-11-24T07:57:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800ca30 con 0x7f6f240b1000 2023-11-24T07:57:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f241598c0 con 0x7f6f240b1000 2023-11-24T07:57:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800cdc0 con 0x7f6f240b1000 2023-11-24T07:57:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f241f44a0 con 0x7f6f240b1000 2023-11-24T07:57:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f24159de0 con 0x7f6f240b1000 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.310+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f1801d460 con 0x7f6f240b1000 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.314+0000 7f6f0b7fe640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.314+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f18083e10 con 0x7f6f240b1000 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.314+0000 7f6f22ffd640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.314+0000 7f6f22ffd640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009c60 tx=0x7f6f14009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.314+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f24159de0 con 0x7f6f240b1000 2023-11-24T07:57:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.474+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f2404e850 con 0x7f6f240b1000 2023-11-24T07:57:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f0b7fe640 1 -- 172.21.15.5:0/943740427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f18087030 con 0x7f6f240b1000 2023-11-24T07:57:23.481 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 msgr2=0x7f6f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009c60 tx=0x7f6f14009190 comp rx=0 tx=0).stop 2023-11-24T07:57:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 msgr2=0x7f6f2414b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800eb20 tx=0x7f6f1800ef20 comp rx=0 tx=0).stop 2023-11-24T07:57:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 shutdown_connections 2023-11-24T07:57:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f241f34e0 0x7f6f241f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f240b1000 0x7f6f2414b9f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 --2- 172.21.15.5:0/943740427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f240b0c20 0x7f6f2414b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 >> 172.21.15.5:0/943740427 conn(0x7f6f2409c750 msgr2=0x7f6f2406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 shutdown_connections 2023-11-24T07:57:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.478+0000 7f6f29301640 1 -- 172.21.15.5:0/943740427 wait complete. 2023-11-24T07:57:23.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.642+0000 7f228fbf5640 1 Processor -- start 2023-11-24T07:57:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.642+0000 7f228fbf5640 1 -- start start 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228fbf5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22880cdfb0 0x7f22880abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228fbf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228815a710 0x7f22880ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228fbf5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880ce8d0 con 0x7f22880cbd50 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228fbf5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880cca80 con 0x7f22880cdfb0 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228fbf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b2710 con 0x7f228815a710 2023-11-24T07:57:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22880cdfb0 0x7f22880abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22880cdfb0 0x7f22880abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55170/0 (socket says 172.21.15.5:55170) 2023-11-24T07:57:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 -- 172.21.15.5:0/587970328 learned_addr learned my addr 172.21.15.5:0/587970328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 -- 172.21.15.5:0/587970328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228815a710 msgr2=0x7f22880ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 --2- 172.21.15.5:0/587970328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228815a710 0x7f22880ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 -- 172.21.15.5:0/587970328 >> v1:172.21.15.102:6789/0 conn(0x7f22880cbd50 legacy=0x7f22880cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.646+0000 7f228d991640 1 -- 172.21.15.5:0/587970328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880b29f0 con 0x7f22880cdfb0 2023-11-24T07:57:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228d991640 1 --2- 172.21.15.5:0/587970328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22880cdfb0 0x7f22880abf90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f228400bb10 tx=0x7f228401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356b16783d74e26d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228c98f640 1 -- 172.21.15.5:0/587970328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840a7c30 con 0x7f22880cdfb0 2023-11-24T07:57:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228c98f640 1 -- 172.21.15.5:0/587970328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22840a7d90 con 0x7f22880cdfb0 2023-11-24T07:57:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228c98f640 1 -- 172.21.15.5:0/587970328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840af660 con 0x7f22880cdfb0 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- 172.21.15.5:0/587970328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22880cdfb0 msgr2=0x7f22880abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- 172.21.15.5:0/587970328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22880cdfb0 0x7f22880abf90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f228400bb10 tx=0x7f228401eba0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- 172.21.15.5:0/587970328 shutdown_connections 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- 172.21.15.5:0/587970328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228815a710 0x7f22880ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- 172.21.15.5:0/587970328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22880cdfb0 0x7f22880abf90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- 172.21.15.5:0/587970328 >> 172.21.15.5:0/587970328 conn(0x7f22880b0cb0 msgr2=0x7f22880b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- 172.21.15.5:0/587970328 shutdown_connections 2023-11-24T07:57:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- 172.21.15.5:0/587970328 wait complete. 2023-11-24T07:57:23.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 Processor -- start 2023-11-24T07:57:23.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- start start 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22880cbd50 0x7f2288157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 0x7f228814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288150a40 con 0x7f228815a710 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881595d0 con 0x7f22880cdfb0 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.650+0000 7f228fbf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2288163b40 con 0x7f22880cbd50 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55176/0 (socket says 172.21.15.5:55176) 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 -- 172.21.15.5:0/1708279293 learned_addr learned my addr 172.21.15.5:0/1708279293 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228d991640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22880cbd50 0x7f2288157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228d190640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 0x7f228814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 -- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22880cbd50 msgr2=0x7f2288157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22880cbd50 0x7f2288157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 -- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 msgr2=0x7f228814ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 0x7f228814ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 -- 172.21.15.5:0/1708279293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228400b770 con 0x7f228815a710 2023-11-24T07:57:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228d190640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 0x7f228814ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228e192640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f228000c780 tx=0x7f228000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280003d90 con 0x7f228815a710 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000ce90 con 0x7f228815a710 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800052b0 con 0x7f228815a710 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22881597d0 con 0x7f228815a710 2023-11-24T07:57:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288159d90 con 0x7f228815a710 2023-11-24T07:57:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22880671f0 con 0x7f228815a710 2023-11-24T07:57:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.654+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2280005410 con 0x7f228815a710 2023-11-24T07:57:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.658+0000 7f227e7fc640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 0x7f226c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.658+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22800832b0 con 0x7f228815a710 2023-11-24T07:57:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.658+0000 7f228d991640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 0x7f226c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.658+0000 7f228d991640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 0x7f226c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22840b1000 tx=0x7f22840a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.658+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22800507d0 con 0x7f228815a710 2023-11-24T07:57:23.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.818+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2288150ef0 con 0x7f228815a710 2023-11-24T07:57:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.818+0000 7f227e7fc640 1 -- 172.21.15.5:0/1708279293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2288150ef0 con 0x7f228815a710 2023-11-24T07:57:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 msgr2=0x7f226c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 0x7f226c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22840b1000 tx=0x7f22840a9070 comp rx=0 tx=0).stop 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 msgr2=0x7f2288150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f228000c780 tx=0x7f228000cc40 comp rx=0 tx=0).stop 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 shutdown_connections 2023-11-24T07:57:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f226c066470 0x7f226c068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f228815a710 0x7f2288150500 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22880cdfb0 0x7f228814ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 --2- 172.21.15.5:0/1708279293 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22880cbd50 0x7f2288157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 >> 172.21.15.5:0/1708279293 conn(0x7f22880b0cb0 msgr2=0x7f22880ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 shutdown_connections 2023-11-24T07:57:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.822+0000 7f228fbf5640 1 -- 172.21.15.5:0/1708279293 wait complete. 2023-11-24T07:57:23.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 Processor -- start 2023-11-24T07:57:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 -- start start 2023-11-24T07:57:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d4c0cb9b0 0x7f5d4c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0ce5d0 0x7f5d4c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c159630 con 0x7f5d4c0cbd90 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c15bba0 con 0x7f5d4c0cb9b0 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d51668640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0cdd50 con 0x7f5d4c0ce5d0 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d4c0cb9b0 0x7f5d4c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d43fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5d4c0cbd90 0x7f5d4c15f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42458/0 (socket says 172.21.15.5:42458) 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d43fff640 1 -- 172.21.15.5:0/465267358 learned_addr learned my addr 172.21.15.5:0/465267358 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4b7fe640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0ce5d0 0x7f5d4c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4affd640 1 -- 172.21.15.5:0/465267358 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0ce5d0 msgr2=0x7f5d4c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4affd640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0ce5d0 0x7f5d4c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4a7fc640 1 -- 172.21.15.5:0/465267358 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940245027 0 0) 0x7f5d4c159630 con 0x7f5d4c0cbd90 2023-11-24T07:57:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4affd640 1 -- 172.21.15.5:0/465267358 >> v1:172.21.15.5:6789/0 conn(0x7f5d4c0cbd90 legacy=0x7f5d4c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.990+0000 7f5d4affd640 1 -- 172.21.15.5:0/465267358 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0cd1d0 con 0x7f5d4c0cb9b0 2023-11-24T07:57:23.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d4affd640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cb9b0 0x7f5d4c06e3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0097c0 tx=0x7f5d3c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c068d44543037e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d4a7fc640 1 -- 172.21.15.5:0/465267358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0a7070 con 0x7f5d4c0cb9b0 2023-11-24T07:57:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d4a7fc640 1 -- 172.21.15.5:0/465267358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0ab430 con 0x7f5d4c0cb9b0 2023-11-24T07:57:23.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d4a7fc640 1 -- 172.21.15.5:0/465267358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0ab7c0 con 0x7f5d4c0cb9b0 2023-11-24T07:57:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 -- 172.21.15.5:0/465267358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cb9b0 msgr2=0x7f5d4c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cb9b0 0x7f5d4c06e3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0097c0 tx=0x7f5d3c01c450 comp rx=0 tx=0).stop 2023-11-24T07:57:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 -- 172.21.15.5:0/465267358 shutdown_connections 2023-11-24T07:57:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0ce5d0 0x7f5d4c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 --2- 172.21.15.5:0/465267358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cb9b0 0x7f5d4c06e3f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 -- 172.21.15.5:0/465267358 >> 172.21.15.5:0/465267358 conn(0x7f5d4c0b0cb0 msgr2=0x7f5d4c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 -- 172.21.15.5:0/465267358 shutdown_connections 2023-11-24T07:57:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.994+0000 7f5d51668640 1 -- 172.21.15.5:0/465267358 wait complete. 2023-11-24T07:57:24.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 Processor -- start 2023-11-24T07:57:24.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- start start 2023-11-24T07:57:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0cb9b0 0x7f5d4c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d4c0ce5d0 0x7f5d4c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c154bc0 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c154ea0 con 0x7f5d4c0ce5d0 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c153190 con 0x7f5d4c0cb9b0 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55200/0 (socket says 172.21.15.5:55200) 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 -- 172.21.15.5:0/2561554033 learned_addr learned my addr 172.21.15.5:0/2561554033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d4affd640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0cb9b0 0x7f5d4c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d4b7fe640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d4c0ce5d0 0x7f5d4c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 -- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0cb9b0 msgr2=0x7f5d4c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0cb9b0 0x7f5d4c15dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 -- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d4c0ce5d0 msgr2=0x7f5d4c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d4c0ce5d0 0x7f5d4c06c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 -- 172.21.15.5:0/2561554033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009420 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d43fff640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c520 tx=0x7f5d3400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340074e0 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34007640 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340049f0 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c153470 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c15e500 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:23.998+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c0671f0 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.002+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d34004b50 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.002+0000 7f5d437fe640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 0x7f5d2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.002+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d34083100 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.002+0000 7f5d4affd640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 0x7f5d2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.002+0000 7f5d4affd640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 0x7f5d2c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.006+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d34050590 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d4c06b460 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d437fe640 1 -- 172.21.15.5:0/2561554033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d34018020 con 0x7f5d4c0cbd90 2023-11-24T07:57:24.174 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 msgr2=0x7f5d2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 0x7f5d2c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 msgr2=0x7f5d4c15a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c520 tx=0x7f5d3400c9e0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 shutdown_connections 2023-11-24T07:57:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5d2c066470 0x7f5d2c068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d4c0ce5d0 0x7f5d4c06c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d4c0cbd90 0x7f5d4c15a0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 --2- 172.21.15.5:0/2561554033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d4c0cb9b0 0x7f5d4c15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 >> 172.21.15.5:0/2561554033 conn(0x7f5d4c0b0cb0 msgr2=0x7f5d4c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 shutdown_connections 2023-11-24T07:57:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.170+0000 7f5d51668640 1 -- 172.21.15.5:0/2561554033 wait complete. 2023-11-24T07:57:24.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.334+0000 7f85b245a640 1 Processor -- start 2023-11-24T07:57:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.334+0000 7f85b245a640 1 -- start start 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b245a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85ac15a710 0x7f85ac0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b245a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0b2710 con 0x7f85ac0cbd50 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b245a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0b29f0 con 0x7f85ac0cdfb0 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b245a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0cca80 con 0x7f85ac15a710 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b09f7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85ac0cbd50 0x7f85ac0cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42472/0 (socket says 172.21.15.5:42472) 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85b09f7640 1 -- 172.21.15.5:0/1185921120 learned_addr learned my addr 172.21.15.5:0/1185921120 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/1185921120 >> v2:172.21.15.102:3300/0 conn(0x7f85ac15a710 0x7f85ac0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85aaffd640 1 -- 172.21.15.5:0/1185921120 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145528572 0 0) 0x7f85ac0b2710 con 0x7f85ac0cbd50 2023-11-24T07:57:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85aaffd640 1 -- 172.21.15.5:0/1185921120 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8594005740 con 0x7f85ac0cbd50 2023-11-24T07:57:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85ab7fe640 1 -- 172.21.15.5:0/1185921120 >> v1:172.21.15.102:6789/0 conn(0x7f85ac0cdfb0 legacy=0x7f85ac0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85ab7fe640 1 -- 172.21.15.5:0/1185921120 >> v1:172.21.15.5:6789/0 conn(0x7f85ac0cbd50 legacy=0x7f85ac0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.338+0000 7f85ab7fe640 1 -- 172.21.15.5:0/1185921120 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0b2cd0 con 0x7f85ac15a710 2023-11-24T07:57:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/1185921120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac0abf90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85a00097c0 tx=0x7f85a001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4ed68dac94c2dad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85aaffd640 1 -- 172.21.15.5:0/1185921120 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00ab670 con 0x7f85ac15a710 2023-11-24T07:57:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85aaffd640 1 -- 172.21.15.5:0/1185921120 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00ab7d0 con 0x7f85ac15a710 2023-11-24T07:57:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85aaffd640 1 -- 172.21.15.5:0/1185921120 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00abb60 con 0x7f85ac15a710 2023-11-24T07:57:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 -- 172.21.15.5:0/1185921120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 msgr2=0x7f85ac0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 --2- 172.21.15.5:0/1185921120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac0abf90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85a00097c0 tx=0x7f85a001c450 comp rx=0 tx=0).stop 2023-11-24T07:57:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 -- 172.21.15.5:0/1185921120 shutdown_connections 2023-11-24T07:57:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 --2- 172.21.15.5:0/1185921120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac0abf90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 -- 172.21.15.5:0/1185921120 >> 172.21.15.5:0/1185921120 conn(0x7f85ac0b0cb0 msgr2=0x7f85ac0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 -- 172.21.15.5:0/1185921120 shutdown_connections 2023-11-24T07:57:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 -- 172.21.15.5:0/1185921120 wait complete. 2023-11-24T07:57:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.342+0000 7f85b245a640 1 Processor -- start 2023-11-24T07:57:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- start start 2023-11-24T07:57:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac155570 con 0x7f85ac0cbd50 2023-11-24T07:57:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1f5af0 con 0x7f85ac15a710 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac164420 con 0x7f85ac0cdfb0 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55202/0 (socket says 172.21.15.5:55202) 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 -- 172.21.15.5:0/472208770 learned_addr learned my addr 172.21.15.5:0/472208770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b09f7640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 -- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 msgr2=0x7f85ac154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 -- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 msgr2=0x7f85ac155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 -- 172.21.15.5:0/472208770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009420 con 0x7f85ac0cbd50 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b09f7640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85abfff640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c500 tx=0x7f859c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c005220 con 0x7f85ac0cbd50 2023-11-24T07:57:24.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c005380 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac164700 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c007270 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac164cc0 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.346+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac0671f0 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.350+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f859c0073d0 con 0x7f85ac0cbd50 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.350+0000 7f85a8ff9640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 0x7f8598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.350+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f859c083800 con 0x7f85ac0cbd50 2023-11-24T07:57:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.350+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 0x7f8598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.350+0000 7f85ab7fe640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 0x7f8598068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85a00af000 tx=0x7f85a00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.354+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f859c050bf0 con 0x7f85ac0cbd50 2023-11-24T07:57:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85ac06b460 con 0x7f85ac0cbd50 2023-11-24T07:57:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85a8ff9640 1 -- 172.21.15.5:0/472208770 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f859c054210 con 0x7f85ac0cbd50 2023-11-24T07:57:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 msgr2=0x7f8598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 0x7f8598068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85a00af000 tx=0x7f85a00a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 msgr2=0x7f85ac1f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c500 tx=0x7f859c00c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 shutdown_connections 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8598066470 0x7f8598068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85ac15a710 0x7f85ac155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85ac0cdfb0 0x7f85ac154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 --2- 172.21.15.5:0/472208770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85ac0cbd50 0x7f85ac1f55b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 >> 172.21.15.5:0/472208770 conn(0x7f85ac0b0cb0 msgr2=0x7f85ac0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 shutdown_connections 2023-11-24T07:57:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.522+0000 7f85b245a640 1 -- 172.21.15.5:0/472208770 wait complete. 2023-11-24T07:57:24.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T07:57:24.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:24.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T07:57:24.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:57:24.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:24.583 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T07:57:24.639 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:24.639 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:24.648 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:24.649 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:24.701 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:24.701 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:24.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:24.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 Processor -- start 2023-11-24T07:57:24.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 -- start start 2023-11-24T07:57:24.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1db8071cc0 0x7f1db80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db80adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80ad740 con 0x7f1db806e410 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80b3e20 con 0x7f1db8071cc0 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.934+0000 7f1dbe165640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db815dde0 con 0x7f1db80b2ee0 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1db806e410 0x7f1db80715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42480/0 (socket says 172.21.15.5:42480) 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db77fe640 1 -- 172.21.15.5:0/3868047100 learned_addr learned my addr 172.21.15.5:0/3868047100 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 --2- 172.21.15.5:0/3868047100 >> v2:172.21.15.5:3300/0 conn(0x7f1db8071cc0 0x7f1db80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db7fff640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db80adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db67fc640 1 -- 172.21.15.5:0/3868047100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618425793 0 0) 0x7f1db80ad740 con 0x7f1db806e410 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db67fc640 1 -- 172.21.15.5:0/3868047100 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da0003530 con 0x7f1db806e410 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 -- 172.21.15.5:0/3868047100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 msgr2=0x7f1db80adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db80adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 -- 172.21.15.5:0/3868047100 >> v1:172.21.15.5:6789/0 conn(0x7f1db806e410 legacy=0x7f1db80715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 -- 172.21.15.5:0/3868047100 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80b3580 con 0x7f1db8071cc0 2023-11-24T07:57:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db7fff640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db80adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:24.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db6ffd640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db8071cc0 0x7f1db80b29a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0097c0 tx=0x7f1dac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe7b17e40d08c89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db67fc640 1 -- 172.21.15.5:0/3868047100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0ab600 con 0x7f1db8071cc0 2023-11-24T07:57:24.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db67fc640 1 -- 172.21.15.5:0/3868047100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0a7050 con 0x7f1db8071cc0 2023-11-24T07:57:24.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.938+0000 7f1db67fc640 1 -- 172.21.15.5:0/3868047100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0ab980 con 0x7f1db8071cc0 2023-11-24T07:57:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- 172.21.15.5:0/3868047100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db8071cc0 msgr2=0x7f1db80b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db8071cc0 0x7f1db80b29a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0097c0 tx=0x7f1dac01c480 comp rx=0 tx=0).stop 2023-11-24T07:57:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- 172.21.15.5:0/3868047100 shutdown_connections 2023-11-24T07:57:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db80adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- 172.21.15.5:0/3868047100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db8071cc0 0x7f1db80b29a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- 172.21.15.5:0/3868047100 >> 172.21.15.5:0/3868047100 conn(0x7f1db80b1e40 msgr2=0x7f1db8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- 172.21.15.5:0/3868047100 shutdown_connections 2023-11-24T07:57:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- 172.21.15.5:0/3868047100 wait complete. 2023-11-24T07:57:24.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 Processor -- start 2023-11-24T07:57:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- start start 2023-11-24T07:57:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1db8071cc0 0x7f1db81483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db814e340 con 0x7f1db806e410 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db815f8d0 con 0x7f1db8071cc0 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1dbe165640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db815fbb0 con 0x7f1db80b2ee0 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55220/0 (socket says 172.21.15.5:55220) 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 -- 172.21.15.5:0/2252390265 learned_addr learned my addr 172.21.15.5:0/2252390265 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 -- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 msgr2=0x7f1db814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 -- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1db8071cc0 msgr2=0x7f1db81483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:24.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1db8071cc0 0x7f1db81483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:24.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.942+0000 7f1db77fe640 1 -- 172.21.15.5:0/2252390265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009420 con 0x7f1db806e410 2023-11-24T07:57:24.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1db77fe640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1da800c450 tx=0x7f1da800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8005cf0 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8005e50 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8007290 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db815fe90 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db8160450 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8160640 con 0x7f1db806e410 2023-11-24T07:57:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1da80073f0 con 0x7f1db806e410 2023-11-24T07:57:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 0x7f1da4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1da80833e0 con 0x7f1db806e410 2023-11-24T07:57:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.946+0000 7f1db6ffd640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 0x7f1da4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.950+0000 7f1db6ffd640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 0x7f1da4068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0ad000 tx=0x7f1dac004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:24.950+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1da80508d0 con 0x7f1db806e410 2023-11-24T07:57:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.110+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1db804e850 con 0x7f1db806e410 2023-11-24T07:57:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.110+0000 7f1d9ffff640 1 -- 172.21.15.5:0/2252390265 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1da8017090 con 0x7f1db806e410 2023-11-24T07:57:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:25.117 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 msgr2=0x7f1da4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 0x7f1da4068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0ad000 tx=0x7f1dac004740 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 msgr2=0x7f1db8160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1da800c450 tx=0x7f1da800c910 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 shutdown_connections 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1da4066470 0x7f1da4068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1db80b2ee0 0x7f1db814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1db8071cc0 0x7f1db81483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 --2- 172.21.15.5:0/2252390265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db806e410 0x7f1db8160970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 >> 172.21.15.5:0/2252390265 conn(0x7f1db80b1e40 msgr2=0x7f1db80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 shutdown_connections 2023-11-24T07:57:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.114+0000 7f1dbe165640 1 -- 172.21.15.5:0/2252390265 wait complete. 2023-11-24T07:57:25.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:25.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.278+0000 7fc73e3df640 1 Processor -- start 2023-11-24T07:57:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.278+0000 7fc73e3df640 1 -- start start 2023-11-24T07:57:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc73e3df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc73815a710 0x7fc7380abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc73e3df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc7380cbd50 0x7fc7380cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc73e3df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380b2710 con 0x7fc7380cdfb0 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc73e3df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380cca80 con 0x7fc73815a710 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc73e3df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380b29f0 con 0x7fc7380cbd50 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc7377fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc73815a710 0x7fc7380abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc737fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7380cdfb0 0x7fc7380ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42496/0 (socket says 172.21.15.5:42496) 2023-11-24T07:57:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc737fff640 1 -- 172.21.15.5:0/981765733 learned_addr learned my addr 172.21.15.5:0/981765733 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc7377fe640 1 -- 172.21.15.5:0/981765733 >> v2:172.21.15.102:3300/0 conn(0x7fc7380cbd50 msgr2=0x7fc7380cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc7377fe640 1 --2- 172.21.15.5:0/981765733 >> v2:172.21.15.102:3300/0 conn(0x7fc7380cbd50 0x7fc7380cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc7377fe640 1 -- 172.21.15.5:0/981765733 >> v1:172.21.15.5:6789/0 conn(0x7fc7380cdfb0 legacy=0x7fc7380ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc7377fe640 1 -- 172.21.15.5:0/981765733 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380b2cd0 con 0x7fc73815a710 2023-11-24T07:57:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.282+0000 7fc736ffd640 1 -- 172.21.15.5:0/981765733 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023479296 0 0) 0x7fc7380b2710 con 0x7fc7380cdfb0 2023-11-24T07:57:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc7377fe640 1 --2- 172.21.15.5:0/981765733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73815a710 0x7fc7380abf90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7380aead0 tx=0x7fc72c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13f986327606ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc736ffd640 1 -- 172.21.15.5:0/981765733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0ab650 con 0x7fc73815a710 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc736ffd640 1 -- 172.21.15.5:0/981765733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c0ab7b0 con 0x7fc73815a710 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc736ffd640 1 -- 172.21.15.5:0/981765733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0abb40 con 0x7fc73815a710 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- 172.21.15.5:0/981765733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73815a710 msgr2=0x7fc7380abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 --2- 172.21.15.5:0/981765733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73815a710 0x7fc7380abf90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7380aead0 tx=0x7fc72c01c430 comp rx=0 tx=0).stop 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- 172.21.15.5:0/981765733 shutdown_connections 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 --2- 172.21.15.5:0/981765733 >> v2:172.21.15.102:3300/0 conn(0x7fc7380cbd50 0x7fc7380cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 --2- 172.21.15.5:0/981765733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73815a710 0x7fc7380abf90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- 172.21.15.5:0/981765733 >> 172.21.15.5:0/981765733 conn(0x7fc7380b0cb0 msgr2=0x7fc7380b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- 172.21.15.5:0/981765733 shutdown_connections 2023-11-24T07:57:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- 172.21.15.5:0/981765733 wait complete. 2023-11-24T07:57:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 Processor -- start 2023-11-24T07:57:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.286+0000 7fc73e3df640 1 -- start start 2023-11-24T07:57:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 0x7fc738153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc73815a710 0x7fc738071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738072870 con 0x7fc7380cdfb0 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7381fa100 con 0x7fc7380cbd50 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380722b0 con 0x7fc73815a710 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55232/0 (socket says 172.21.15.5:55232) 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 -- 172.21.15.5:0/3729517681 learned_addr learned my addr 172.21.15.5:0/3729517681 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc737fff640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 0x7fc738153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 -- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc73815a710 msgr2=0x7fc738071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc73815a710 0x7fc738071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 -- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 msgr2=0x7fc738153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 0x7fc738153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 -- 172.21.15.5:0/3729517681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009420 con 0x7fc7380cdfb0 2023-11-24T07:57:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc737fff640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 0x7fc738153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc7377fe640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc72c019040 tx=0x7fc72c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0b5810 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c0b5990 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0b5d40 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc738072590 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7381fa670 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7380671f0 con 0x7fc7380cdfb0 2023-11-24T07:57:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.290+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc72c0bf410 con 0x7fc7380cdfb0 2023-11-24T07:57:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.294+0000 7fc734ff9640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 0x7fc724068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.294+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc72c11ebe0 con 0x7fc7380cdfb0 2023-11-24T07:57:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.294+0000 7fc737fff640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 0x7fc724068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.294+0000 7fc737fff640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 0x7fc724068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f70 tx=0x7fc728009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.298+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc72c0ec0e0 con 0x7fc7380cdfb0 2023-11-24T07:57:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc73806b460 con 0x7fc7380cdfb0 2023-11-24T07:57:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc734ff9640 1 -- 172.21.15.5:0/3729517681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc72c0ab610 con 0x7fc7380cdfb0 2023-11-24T07:57:25.462 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 msgr2=0x7fc724068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 0x7fc724068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f70 tx=0x7fc728009040 comp rx=0 tx=0).stop 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 msgr2=0x7fc7381fab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc72c019040 tx=0x7fc72c01ac70 comp rx=0 tx=0).stop 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 shutdown_connections 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc724066470 0x7fc724068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc73815a710 0x7fc738071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7380cdfb0 0x7fc7381fab90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 --2- 172.21.15.5:0/3729517681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7380cbd50 0x7fc738153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 >> 172.21.15.5:0/3729517681 conn(0x7fc7380b0cb0 msgr2=0x7fc738159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 shutdown_connections 2023-11-24T07:57:25.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.458+0000 7fc73e3df640 1 -- 172.21.15.5:0/3729517681 wait complete. 2023-11-24T07:57:25.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 Processor -- start 2023-11-24T07:57:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 -- start start 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e34146820 0x7f9e34070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e340b4210 0x7f9e340b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e34147190 con 0x7f9e34161180 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e340b4be0 con 0x7f9e34146820 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3bd01640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e34146c00 con 0x7f9e340b4210 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e34146820 0x7f9e34070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e34146820 0x7f9e34070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55244/0 (socket says 172.21.15.5:55244) 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 -- 172.21.15.5:0/1296244135 learned_addr learned my addr 172.21.15.5:0/1296244135 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3a29e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9e34161180 0x7f9e34161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42500/0 (socket says 172.21.15.5:42500) 2023-11-24T07:57:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e3929c640 1 --2- 172.21.15.5:0/1296244135 >> v2:172.21.15.102:3300/0 conn(0x7f9e340b4210 0x7f9e340b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 -- 172.21.15.5:0/1296244135 >> v2:172.21.15.102:3300/0 conn(0x7f9e340b4210 msgr2=0x7f9e340b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/1296244135 >> v2:172.21.15.102:3300/0 conn(0x7f9e340b4210 0x7f9e340b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 -- 172.21.15.5:0/1296244135 >> v1:172.21.15.5:6789/0 conn(0x7f9e34161180 legacy=0x7f9e34161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.626+0000 7f9e39a9d640 1 -- 172.21.15.5:0/1296244135 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3406d030 con 0x7f9e34146820 2023-11-24T07:57:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/1296244135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34146820 0x7f9e34070a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e340b5ad0 tx=0x7f9e3001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a127390f278bddd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e38a9b640 1 -- 172.21.15.5:0/1296244135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300aa430 con 0x7f9e34146820 2023-11-24T07:57:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e38a9b640 1 -- 172.21.15.5:0/1296244135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300aa590 con 0x7f9e34146820 2023-11-24T07:57:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e38a9b640 1 -- 172.21.15.5:0/1296244135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300aa920 con 0x7f9e34146820 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 -- 172.21.15.5:0/1296244135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34146820 msgr2=0x7f9e34070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/1296244135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34146820 0x7f9e34070a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e340b5ad0 tx=0x7f9e3001c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 -- 172.21.15.5:0/1296244135 shutdown_connections 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/1296244135 >> v2:172.21.15.102:3300/0 conn(0x7f9e340b4210 0x7f9e340b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/1296244135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34146820 0x7f9e34070a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 -- 172.21.15.5:0/1296244135 >> 172.21.15.5:0/1296244135 conn(0x7f9e340b2f10 msgr2=0x7f9e340b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 -- 172.21.15.5:0/1296244135 shutdown_connections 2023-11-24T07:57:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.630+0000 7f9e3bd01640 1 -- 172.21.15.5:0/1296244135 wait complete. 2023-11-24T07:57:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 Processor -- start 2023-11-24T07:57:25.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- start start 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 0x7f9e34149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 0x7f9e3415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3415d440 con 0x7f9e34161180 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34147510 con 0x7f9e34146820 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e341477f0 con 0x7f9e340b4210 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55258/0 (socket says 172.21.15.5:55258) 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 -- 172.21.15.5:0/3672668834 learned_addr learned my addr 172.21.15.5:0/3672668834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 -- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 msgr2=0x7f9e34149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3929c640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 0x7f9e3415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 0x7f9e34149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 0x7f9e34149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 -- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 msgr2=0x7f9e3415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 0x7f9e3415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 -- 172.21.15.5:0/3672668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300094d0 con 0x7f9e34161180 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 0x7f9e34149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3929c640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 0x7f9e3415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3a29e640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c700 tx=0x7f9e2c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ce10 con 0x7f9e34161180 2023-11-24T07:57:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00a640 con 0x7f9e34161180 2023-11-24T07:57:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e34147ad0 con 0x7f9e34161180 2023-11-24T07:57:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00a9b0 con 0x7f9e34161180 2023-11-24T07:57:25.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.634+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3415d150 con 0x7f9e34161180 2023-11-24T07:57:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3404e850 con 0x7f9e34161180 2023-11-24T07:57:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e2c00ab10 con 0x7f9e34161180 2023-11-24T07:57:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e2a7fc640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e2c083520 con 0x7f9e34161180 2023-11-24T07:57:25.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.638+0000 7f9e39a9d640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 0x7f9e18068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e300ae000 tx=0x7f9e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.642+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e2c050a40 con 0x7f9e34161180 2023-11-24T07:57:25.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.798+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e34147f80 con 0x7f9e34161180 2023-11-24T07:57:25.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.798+0000 7f9e2a7fc640 1 -- 172.21.15.5:0/3672668834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e2c054060 con 0x7f9e34161180 2023-11-24T07:57:25.803 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:25.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 msgr2=0x7f9e18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 0x7f9e18068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e300ae000 tx=0x7f9e30008040 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 msgr2=0x7f9e3415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c700 tx=0x7f9e2c00cbc0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 shutdown_connections 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9e18066470 0x7f9e18068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e34161180 0x7f9e3415cc10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34146820 0x7f9e3415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 --2- 172.21.15.5:0/3672668834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e340b4210 0x7f9e34149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 >> 172.21.15.5:0/3672668834 conn(0x7f9e340b2f10 msgr2=0x7f9e3413bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 shutdown_connections 2023-11-24T07:57:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.802+0000 7f9e3bd01640 1 -- 172.21.15.5:0/3672668834 wait complete. 2023-11-24T07:57:25.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 Processor -- start 2023-11-24T07:57:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 -- start start 2023-11-24T07:57:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00cb9b0 0x7f59a006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a00cbd90 0x7f59a015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a0159630 con 0x7f59a00ce5d0 2023-11-24T07:57:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a015bba0 con 0x7f59a00cbd90 2023-11-24T07:57:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a75c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00cdd50 con 0x7f59a00cb9b0 2023-11-24T07:57:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a00cbd90 0x7f59a015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a00cbd90 0x7f59a015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55266/0 (socket says 172.21.15.5:55266) 2023-11-24T07:57:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 -- 172.21.15.5:0/3095474892 learned_addr learned my addr 172.21.15.5:0/3095474892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a535d640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00cb9b0 0x7f59a006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 -- 172.21.15.5:0/3095474892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00cb9b0 msgr2=0x7f59a006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00cb9b0 0x7f59a006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 -- 172.21.15.5:0/3095474892 >> v1:172.21.15.102:6789/0 conn(0x7f59a00ce5d0 legacy=0x7f59a015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.966+0000 7f59a4b5c640 1 -- 172.21.15.5:0/3095474892 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a015f6d0 con 0x7f59a00cbd90 2023-11-24T07:57:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a4b5c640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cbd90 0x7f59a015f190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5990009870 tx=0x7f599001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dfa0f8e004b09d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f5997fff640 1 -- 172.21.15.5:0/3095474892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900aa670 con 0x7f59a00cbd90 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f5997fff640 1 -- 172.21.15.5:0/3095474892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59900aa7d0 con 0x7f59a00cbd90 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f5997fff640 1 -- 172.21.15.5:0/3095474892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900aab60 con 0x7f59a00cbd90 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 -- 172.21.15.5:0/3095474892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cbd90 msgr2=0x7f59a015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cbd90 0x7f59a015f190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5990009870 tx=0x7f599001c510 comp rx=0 tx=0).stop 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 -- 172.21.15.5:0/3095474892 shutdown_connections 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cbd90 0x7f59a015f190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 --2- 172.21.15.5:0/3095474892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00cb9b0 0x7f59a006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 -- 172.21.15.5:0/3095474892 >> 172.21.15.5:0/3095474892 conn(0x7f59a00b0cb0 msgr2=0x7f59a00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 -- 172.21.15.5:0/3095474892 shutdown_connections 2023-11-24T07:57:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.970+0000 7f59a75c1640 1 -- 172.21.15.5:0/3095474892 wait complete. 2023-11-24T07:57:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 Processor -- start 2023-11-24T07:57:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- start start 2023-11-24T07:57:25.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59a00cbd90 0x7f59a01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00ce5d0 0x7f59a00b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0164db0 con 0x7f59a00cb9b0 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b3610 con 0x7f59a00cbd90 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01646f0 con 0x7f59a00ce5d0 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55276/0 (socket says 172.21.15.5:55276) 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 -- 172.21.15.5:0/1251260878 learned_addr learned my addr 172.21.15.5:0/1251260878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a4b5c640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59a00cbd90 0x7f59a01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a5b5e640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00ce5d0 0x7f59a00b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 -- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00ce5d0 msgr2=0x7f59a00b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00ce5d0 0x7f59a00b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 -- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59a00cbd90 msgr2=0x7f59a01567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59a00cbd90 0x7f59a01567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 -- 172.21.15.5:0/1251260878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900094d0 con 0x7f59a00cb9b0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a535d640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e930 tx=0x7f599c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c009690 con 0x7f59a00cb9b0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00ca00 con 0x7f59a00cb9b0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00cd70 con 0x7f59a00cb9b0 2023-11-24T07:57:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a01649d0 con 0x7f59a00cb9b0 2023-11-24T07:57:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.974+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00b0630 con 0x7f59a00cb9b0 2023-11-24T07:57:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.978+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a0165020 con 0x7f59a00cb9b0 2023-11-24T07:57:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.978+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f599c013470 con 0x7f59a00cb9b0 2023-11-24T07:57:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.978+0000 7f5995ffb640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 0x7f5984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:25.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.978+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f599c084080 con 0x7f59a00cb9b0 2023-11-24T07:57:25.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.978+0000 7f59a4b5c640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 0x7f5984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:25.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.982+0000 7f59a4b5c640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 0x7f5984068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59900ae000 tx=0x7f59900b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:25.982+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f599c0b5280 con 0x7f59a00cb9b0 2023-11-24T07:57:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.142+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59a00671f0 con 0x7f59a00cb9b0 2023-11-24T07:57:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.142+0000 7f5995ffb640 1 -- 172.21.15.5:0/1251260878 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f599c021020 con 0x7f59a00cb9b0 2023-11-24T07:57:26.147 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 msgr2=0x7f5984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 0x7f5984068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59900ae000 tx=0x7f59900b5040 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 msgr2=0x7f59a00b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e930 tx=0x7f599c00edf0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 shutdown_connections 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f59840664a0 0x7f5984068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59a00ce5d0 0x7f59a00b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59a00cbd90 0x7f59a01567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 --2- 172.21.15.5:0/1251260878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a00cb9b0 0x7f59a00b3030 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 >> 172.21.15.5:0/1251260878 conn(0x7f59a00b0cb0 msgr2=0x7f59a006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 shutdown_connections 2023-11-24T07:57:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.146+0000 7f59a75c1640 1 -- 172.21.15.5:0/1251260878 wait complete. 2023-11-24T07:57:26.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 Processor -- start 2023-11-24T07:57:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 -- start start 2023-11-24T07:57:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40b2590 con 0x7f08c40b3c60 2023-11-24T07:57:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c40b2870 con 0x7f08c4162190 2023-11-24T07:57:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08cc24d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40b2b50 con 0x7f08c40b4040 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08ca7ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c9fe9640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f08c40b3c60 0x7f08c40ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:41074/0 (socket says 172.21.15.5:41074) 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:37536/0 (socket says 172.21.15.5:37536) 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08ca7ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:36464/0 (socket says 172.21.15.5:36464) 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c9fe9640 1 -- 172.21.15.5:0/1843771094 learned_addr learned my addr 172.21.15.5:0/1843771094 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c8fe7640 1 -- 172.21.15.5:0/1843771094 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174308544 0 0) 0x7f08c40b2590 con 0x7f08c40b3c60 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 -- 172.21.15.5:0/1843771094 >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 msgr2=0x7f08c4162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 --2- 172.21.15.5:0/1843771094 >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 -- 172.21.15.5:0/1843771094 >> v1:172.21.15.102:6789/0 conn(0x7f08c40b3c60 legacy=0x7f08c40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08c97e8640 1 -- 172.21.15.5:0/1843771094 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40b2e30 con 0x7f08c40b4040 2023-11-24T07:57:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.310+0000 7f08ca7ea640 1 --2- 172.21.15.5:0/1843771094 >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08c97e8640 1 --2- 172.21.15.5:0/1843771094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08b40097c0 tx=0x7f08b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c2ae5dff80c7b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08c8fe7640 1 -- 172.21.15.5:0/1843771094 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40ab670 con 0x7f08c40b4040 2023-11-24T07:57:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08c8fe7640 1 -- 172.21.15.5:0/1843771094 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40ab7d0 con 0x7f08c40b4040 2023-11-24T07:57:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08c8fe7640 1 -- 172.21.15.5:0/1843771094 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40abb60 con 0x7f08c40b4040 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 -- 172.21.15.5:0/1843771094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 msgr2=0x7f08c40b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 --2- 172.21.15.5:0/1843771094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08b40097c0 tx=0x7f08b401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 -- 172.21.15.5:0/1843771094 shutdown_connections 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 --2- 172.21.15.5:0/1843771094 >> v2:172.21.15.102:3300/0 conn(0x7f08c4162190 0x7f08c4162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 --2- 172.21.15.5:0/1843771094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c40b4040 0x7f08c40b1fb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 -- 172.21.15.5:0/1843771094 >> 172.21.15.5:0/1843771094 conn(0x7f08c40b0cb0 msgr2=0x7f08c40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 -- 172.21.15.5:0/1843771094 shutdown_connections 2023-11-24T07:57:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.314+0000 7f08cc24d640 1 -- 172.21.15.5:0/1843771094 wait complete. 2023-11-24T07:57:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 Processor -- start 2023-11-24T07:57:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- start start 2023-11-24T07:57:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08c40b3c60 0x7f08c414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c414f280 0x7f08c41fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c415b8a0 con 0x7f08c4162190 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c415b0b0 con 0x7f08c40b3c60 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41fa800 con 0x7f08c414f280 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55286/0 (socket says 172.21.15.5:55286) 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 -- 172.21.15.5:0/4251385569 learned_addr learned my addr 172.21.15.5:0/4251385569 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c9fe9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08c40b3c60 0x7f08c414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08ca7ea640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c414f280 0x7f08c41fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 -- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c414f280 msgr2=0x7f08c41fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c414f280 0x7f08c41fb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 -- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08c40b3c60 msgr2=0x7f08c414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08c40b3c60 0x7f08c414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 -- 172.21.15.5:0/4251385569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc009a70 con 0x7f08c4162190 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08c97e8640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08b40ad040 tx=0x7f08b401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40b5810 con 0x7f08c4162190 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40b5990 con 0x7f08c4162190 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b4009420 con 0x7f08c4162190 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40b5d40 con 0x7f08c4162190 2023-11-24T07:57:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.318+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c4153300 con 0x7f08c4162190 2023-11-24T07:57:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40671f0 con 0x7f08c4162190 2023-11-24T07:57:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08b40bf410 con 0x7f08c4162190 2023-11-24T07:57:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08ba7fc640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 0x7f08a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b411ed10 con 0x7f08c4162190 2023-11-24T07:57:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08c9fe9640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 0x7f08a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.322+0000 7f08c9fe9640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 0x7f08a8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08c0007fd0 tx=0x7f08c0007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.326+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08b40ec1a0 con 0x7f08c4162190 2023-11-24T07:57:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.494+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f08c406b460 con 0x7f08c4162190 2023-11-24T07:57:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08ba7fc640 1 -- 172.21.15.5:0/4251385569 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f08b40ef7c0 con 0x7f08c4162190 2023-11-24T07:57:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 msgr2=0x7f08a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 0x7f08a8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08c0007fd0 tx=0x7f08c0007d60 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 msgr2=0x7f08c415ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08b40ad040 tx=0x7f08b401ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 shutdown_connections 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08a8066470 0x7f08a8068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08c414f280 0x7f08c41fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c4162190 0x7f08c415ab70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 --2- 172.21.15.5:0/4251385569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08c40b3c60 0x7f08c414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 >> 172.21.15.5:0/4251385569 conn(0x7f08c40b0cb0 msgr2=0x7f08c40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:26.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 shutdown_connections 2023-11-24T07:57:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.498+0000 7f08cc24d640 1 -- 172.21.15.5:0/4251385569 wait complete. 2023-11-24T07:57:26.522 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T07:57:26.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:26.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T07:57:26.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:57:26.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:26.547 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T07:57:26.597 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:26.598 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:26.608 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:26.608 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:26.660 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:26.660 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:26.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.854+0000 7fb5e1a9c640 1 Processor -- start 2023-11-24T07:57:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.854+0000 7fb5e1a9c640 1 -- start start 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5e1a9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5dc168160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5e1a9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0cefd0 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5e1a9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0cf2b0 con 0x7fb5dc0cead0 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5e1a9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0d17e0 con 0x7fb5dc0d2080 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5db7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5dc15d7b0 0x7fb5dc0d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42502/0 (socket says 172.21.15.5:42502) 2023-11-24T07:57:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5db7fe640 1 -- 172.21.15.5:0/741755409 learned_addr learned my addr 172.21.15.5:0/741755409 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5dc168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634216704 0 0) 0x7fb5dc0cefd0 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c4003530 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746209175 0 0) 0x7fb5c4003530 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 msgr2=0x7fb5dc168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5dc168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 >> v1:172.21.15.102:6789/0 conn(0x7fb5dc0cead0 legacy=0x7fb5dc0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc06b3f0 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7fb5cc001680 con 0x7fb5dc15d7b0 2023-11-24T07:57:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 >> v1:172.21.15.5:6789/0 conn(0x7fb5dc15d7b0 legacy=0x7fb5dc0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c40039b0 0x7fb5c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c4004d10 0x7fb5c4005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0d17e0 con 0x7fb5c4004d10 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c400bbd0 con 0x7fb5c40039b0 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c400bd90 con 0x7fb5dc0d2080 2023-11-24T07:57:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c4004d10 0x7fb5c4005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5db7fe640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c40039b0 0x7fb5c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5daffd640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 -- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 msgr2=0x7fb5c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc0d2080 0x7fb5c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 -- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c40039b0 msgr2=0x7fb5c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c40039b0 0x7fb5c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.858+0000 7fb5dbfff640 1 -- 172.21.15.5:0/741755409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4003530 con 0x7fb5c4004d10 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c4004d10 0x7fb5c4005170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009f90 tx=0x7fb5d401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3d646c6a29642 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40a5be0 con 0x7fb5c4004d10 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400f040 con 0x7fb5c4004d10 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5da7fc640 1 -- 172.21.15.5:0/741755409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40ad440 con 0x7fb5c4004d10 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/741755409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c4004d10 msgr2=0x7fb5c4005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/741755409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c4004d10 0x7fb5c4005170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009f90 tx=0x7fb5d401cbf0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5dbfff640 1 -- 172.21.15.5:0/741755409 reap_dead start 2023-11-24T07:57:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/741755409 shutdown_connections 2023-11-24T07:57:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/741755409 >> 172.21.15.5:0/741755409 conn(0x7fb5dc0d33b0 msgr2=0x7fb5dc0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/741755409 shutdown_connections 2023-11-24T07:57:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/741755409 wait complete. 2023-11-24T07:57:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 Processor -- start 2023-11-24T07:57:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.862+0000 7fb5e1a9c640 1 -- start start 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 0x7fb5dc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 0x7fb5dc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc159380 con 0x7fb5dc158f00 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0cd420 con 0x7fb5dc0cbe20 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0cc380 con 0x7fb5dc152b50 2023-11-24T07:57:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55294/0 (socket says 172.21.15.5:55294) 2023-11-24T07:57:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 -- 172.21.15.5:0/1633786898 learned_addr learned my addr 172.21.15.5:0/1633786898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 -- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 msgr2=0x7fb5dc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5daffd640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 0x7fb5dc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5db7fe640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 0x7fb5dc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 0x7fb5dc0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 -- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 msgr2=0x7fb5dc1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 0x7fb5dc1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 -- 172.21.15.5:0/1633786898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0cc660 con 0x7fb5dc158f00 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5daffd640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 0x7fb5dc1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5db7fe640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 0x7fb5dc0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5dbfff640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009f90 tx=0x7fb5d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40039a0 con 0x7fb5dc158f00 2023-11-24T07:57:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4003b00 con 0x7fb5dc158f00 2023-11-24T07:57:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4003e90 con 0x7fb5dc158f00 2023-11-24T07:57:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0cc940 con 0x7fb5dc158f00 2023-11-24T07:57:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc0ccf00 con 0x7fb5dc158f00 2023-11-24T07:57:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.866+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0cd0f0 con 0x7fb5dc158f00 2023-11-24T07:57:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.870+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5d40b4040 con 0x7fb5dc158f00 2023-11-24T07:57:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.870+0000 7fb5c3fff640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 0x7fb5c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.870+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d411db60 con 0x7fb5dc158f00 2023-11-24T07:57:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.870+0000 7fb5db7fe640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 0x7fb5c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.870+0000 7fb5db7fe640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 0x7fb5c8068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000c10 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:26.874+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5d40eaff0 con 0x7fb5dc158f00 2023-11-24T07:57:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.034+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5dc04e850 con 0x7fb5dc158f00 2023-11-24T07:57:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.034+0000 7fb5c3fff640 1 -- 172.21.15.5:0/1633786898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fb5d40b2090 con 0x7fb5dc158f00 2023-11-24T07:57:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:27.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 msgr2=0x7fb5c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 0x7fb5c8068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000c10 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2023-11-24T07:57:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 msgr2=0x7fb5dc156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009f90 tx=0x7fb5d4009750 comp rx=0 tx=0).stop 2023-11-24T07:57:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 shutdown_connections 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5c80664a0 0x7fb5c8068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5dc158f00 0x7fb5dc156600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5dc0cbe20 0x7fb5dc1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 --2- 172.21.15.5:0/1633786898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5dc152b50 0x7fb5dc0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 >> 172.21.15.5:0/1633786898 conn(0x7fb5dc0d33b0 msgr2=0x7fb5dc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 shutdown_connections 2023-11-24T07:57:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.038+0000 7fb5e1a9c640 1 -- 172.21.15.5:0/1633786898 wait complete. 2023-11-24T07:57:27.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:27.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 Processor -- start 2023-11-24T07:57:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 -- start start 2023-11-24T07:57:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe47c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c159630 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c15f6d0 con 0x7fe47c0cb9b0 2023-11-24T07:57:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.202+0000 7fe481468640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15bba0 con 0x7fe47c06e3f0 2023-11-24T07:57:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe47c0ce5d0 0x7fe47c15bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51970/0 (socket says 172.21.15.5:51970) 2023-11-24T07:57:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47b7fe640 1 -- 172.21.15.5:0/1653575640 learned_addr learned my addr 172.21.15.5:0/1653575640 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe473fff640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe47c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746259208 0 0) 0x7fe47c159630 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003530 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852041039 0 0) 0x7fe47c15f6d0 con 0x7fe47c0cb9b0 2023-11-24T07:57:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe47c159630 con 0x7fe47c0cb9b0 2023-11-24T07:57:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 587599388 0 0) 0x7fe468003530 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 msgr2=0x7fe47c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe47c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 >> v1:172.21.15.102:6789/0 conn(0x7fe47c0cb9b0 legacy=0x7fe47c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0cd1d0 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7fe474001a00 con 0x7fe47c0ce5d0 2023-11-24T07:57:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 >> v1:172.21.15.5:6789/0 conn(0x7fe47c0ce5d0 legacy=0x7fe47c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe468003b40 0x7fe468003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe4680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468004d10 0x7fe468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800ba40 con 0x7fe468003b40 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800bb80 con 0x7fe468004d10 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800bd40 con 0x7fe47c06e3f0 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe468003b40 0x7fe468003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe473fff640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe4680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47b7fe640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468004d10 0x7fe468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 -- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 msgr2=0x7fe4680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c06e3f0 0x7fe4680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 -- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468004d10 msgr2=0x7fe468005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468004d10 0x7fe468005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47affd640 1 -- 172.21.15.5:0/1653575640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468003530 con 0x7fe468003b40 2023-11-24T07:57:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.206+0000 7fe47b7fe640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468004d10 0x7fe468005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe47affd640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe468003b40 0x7fe468003f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0018d0 tx=0x7fe46c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c4645e2a2371ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0052d0 con 0x7fe468003b40 2023-11-24T07:57:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0a7050 con 0x7fe468003b40 2023-11-24T07:57:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe47a7fc640 1 -- 172.21.15.5:0/1653575640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003600 con 0x7fe468003b40 2023-11-24T07:57:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- 172.21.15.5:0/1653575640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe468003b40 msgr2=0x7fe468003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 --2- 172.21.15.5:0/1653575640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe468003b40 0x7fe468003f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0018d0 tx=0x7fe46c01c560 comp rx=0 tx=0).stop 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe47b7fe640 1 -- 172.21.15.5:0/1653575640 reap_dead start 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- 172.21.15.5:0/1653575640 shutdown_connections 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- 172.21.15.5:0/1653575640 >> 172.21.15.5:0/1653575640 conn(0x7fe47c0b0cb0 msgr2=0x7fe47c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- 172.21.15.5:0/1653575640 shutdown_connections 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- 172.21.15.5:0/1653575640 wait complete. 2023-11-24T07:57:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 Processor -- start 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.210+0000 7fe481468640 1 -- start start 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468003b40 0x7fe47c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 0x7fe47c161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0ad070 con 0x7fe47c0acc10 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b0860 con 0x7fe468003b40 2023-11-24T07:57:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0ac130 con 0x7fe47c0b0230 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46678/0 (socket says 172.21.15.5:46678) 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 -- 172.21.15.5:0/2081432018 learned_addr learned my addr 172.21.15.5:0/2081432018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe47b7fe640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 0x7fe47c161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe47affd640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468003b40 0x7fe47c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 -- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 msgr2=0x7fe47c161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 0x7fe47c161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 -- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468003b40 msgr2=0x7fe47c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468003b40 0x7fe47c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 -- 172.21.15.5:0/2081432018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0ac410 con 0x7fe47c0acc10 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe47b7fe640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 0x7fe47c161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe473fff640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4640119d0 tx=0x7fe464011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400fb50 con 0x7fe47c0acc10 2023-11-24T07:57:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400fcb0 con 0x7fe47c0acc10 2023-11-24T07:57:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464014440 con 0x7fe47c0acc10 2023-11-24T07:57:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c0ac6f0 con 0x7fe47c0acc10 2023-11-24T07:57:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c161870 con 0x7fe47c0acc10 2023-11-24T07:57:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c0671f0 con 0x7fe47c0acc10 2023-11-24T07:57:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.214+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4640145a0 con 0x7fe47c0acc10 2023-11-24T07:57:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.218+0000 7fe4737fe640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 0x7fe45c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.218+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4640847a0 con 0x7fe47c0acc10 2023-11-24T07:57:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.218+0000 7fe47affd640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 0x7fe45c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.218+0000 7fe47affd640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 0x7fe45c068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ac000 tx=0x7fe46c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.222+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe464051cd0 con 0x7fe47c0acc10 2023-11-24T07:57:27.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.382+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe47c0abf90 con 0x7fe47c0acc10 2023-11-24T07:57:27.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.382+0000 7fe4737fe640 1 -- 172.21.15.5:0/2081432018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe47c0abf90 con 0x7fe47c0acc10 2023-11-24T07:57:27.388 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 msgr2=0x7fe45c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 0x7fe45c068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ac000 tx=0x7fe46c0a6000 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 msgr2=0x7fe47c0afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4640119d0 tx=0x7fe464011e90 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 shutdown_connections 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe45c066470 0x7fe45c068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe47c0b0230 0x7fe47c161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0acc10 0x7fe47c0afcf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 --2- 172.21.15.5:0/2081432018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe468003b40 0x7fe47c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 >> 172.21.15.5:0/2081432018 conn(0x7fe47c0b0cb0 msgr2=0x7fe47c15f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 shutdown_connections 2023-11-24T07:57:27.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.386+0000 7fe481468640 1 -- 172.21.15.5:0/2081432018 wait complete. 2023-11-24T07:57:27.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:27.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.550+0000 7f80adc17640 1 Processor -- start 2023-11-24T07:57:27.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.550+0000 7f80adc17640 1 -- start start 2023-11-24T07:57:27.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80adc17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80a80ce5d0 0x7f80a815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80adc17640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a8159630 con 0x7f80a806e3f0 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80adc17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80cd1d0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80adc17640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a806e860 con 0x7f80a80ce5d0 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80a80ce5d0 0x7f80a815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80a806e3f0 0x7f80a815f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51976/0 (socket says 172.21.15.5:51976) 2023-11-24T07:57:27.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a6ffd640 1 -- 172.21.15.5:0/3727984098 learned_addr learned my addr 172.21.15.5:0/3727984098 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:27.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a7fff640 1 -- 172.21.15.5:0/3727984098 >> v1:172.21.15.102:6789/0 conn(0x7f80a80cb9b0 legacy=0x7f80a80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a7fff640 1 -- 172.21.15.5:0/3727984098 >> v1:172.21.15.5:6789/0 conn(0x7f80a806e3f0 legacy=0x7f80a815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a7fff640 1 -- 172.21.15.5:0/3727984098 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80cd4b0 con 0x7f80a80ce5d0 2023-11-24T07:57:27.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a67fc640 1 -- 172.21.15.5:0/3727984098 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351067338 0 0) 0x7f80a8159630 con 0x7f80a806e3f0 2023-11-24T07:57:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a7fff640 1 --2- 172.21.15.5:0/3727984098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80ce5d0 0x7f80a815bfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009d90 tx=0x7f80a001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b559787b3486cd69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a67fc640 1 -- 172.21.15.5:0/3727984098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a00a57f0 con 0x7f80a80ce5d0 2023-11-24T07:57:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a67fc640 1 -- 172.21.15.5:0/3727984098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a00a5950 con 0x7f80a80ce5d0 2023-11-24T07:57:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.554+0000 7f80a67fc640 1 -- 172.21.15.5:0/3727984098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a00a5ce0 con 0x7f80a80ce5d0 2023-11-24T07:57:27.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- 172.21.15.5:0/3727984098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80ce5d0 msgr2=0x7f80a815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 --2- 172.21.15.5:0/3727984098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80ce5d0 0x7f80a815bfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009d90 tx=0x7f80a001c950 comp rx=0 tx=0).stop 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- 172.21.15.5:0/3727984098 shutdown_connections 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 --2- 172.21.15.5:0/3727984098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80ce5d0 0x7f80a815bfd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- 172.21.15.5:0/3727984098 >> 172.21.15.5:0/3727984098 conn(0x7f80a80b0cb0 msgr2=0x7f80a80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- 172.21.15.5:0/3727984098 shutdown_connections 2023-11-24T07:57:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- 172.21.15.5:0/3727984098 wait complete. 2023-11-24T07:57:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 Processor -- start 2023-11-24T07:57:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- start start 2023-11-24T07:57:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80a806e3f0 0x7f80a80c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80a80ce5d0 0x7f80a814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a815b0f0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80c9170 con 0x7f80a806e3f0 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80adc17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a815a1a0 con 0x7f80a80ce5d0 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46694/0 (socket says 172.21.15.5:46694) 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80a6ffd640 1 -- 172.21.15.5:0/516328868 learned_addr learned my addr 172.21.15.5:0/516328868 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80a77fe640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80a806e3f0 0x7f80a80c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.558+0000 7f80a7fff640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80a80ce5d0 0x7f80a814e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 -- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80a80ce5d0 msgr2=0x7f80a814e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80a80ce5d0 0x7f80a814e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 -- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80a806e3f0 msgr2=0x7f80a80c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80a806e3f0 0x7f80a80c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 -- 172.21.15.5:0/516328868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009a70 con 0x7f80a80cb9b0 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80a6ffd640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c4a0 tx=0x7f809c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0074e0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c007640 con 0x7f80a80cb9b0 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c004a30 con 0x7f80a80cb9b0 2023-11-24T07:57:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a80c93e0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a80c99a0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a80671f0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f809c004b90 con 0x7f80a80cb9b0 2023-11-24T07:57:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 0x7f8094068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.562+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f809c082ef0 con 0x7f80a80cb9b0 2023-11-24T07:57:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.566+0000 7f80a77fe640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 0x7f8094068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.566+0000 7f80a77fe640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 0x7f8094068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8098007fd0 tx=0x7f8098009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.566+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f809c050410 con 0x7f80a80cb9b0 2023-11-24T07:57:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.726+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80a806b460 con 0x7f80a80cb9b0 2023-11-24T07:57:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.726+0000 7f808ffff640 1 -- 172.21.15.5:0/516328868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f809c018020 con 0x7f80a80cb9b0 2023-11-24T07:57:27.732 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 msgr2=0x7f8094068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 0x7f8094068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8098007fd0 tx=0x7f8098009040 comp rx=0 tx=0).stop 2023-11-24T07:57:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 msgr2=0x7f80a81506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c4a0 tx=0x7f809c00c960 comp rx=0 tx=0).stop 2023-11-24T07:57:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 shutdown_connections 2023-11-24T07:57:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80940664a0 0x7f8094068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80a80ce5d0 0x7f80a814e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80a80cb9b0 0x7f80a81506d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 --2- 172.21.15.5:0/516328868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80a806e3f0 0x7f80a80c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 >> 172.21.15.5:0/516328868 conn(0x7f80a80b0cb0 msgr2=0x7f80a815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 shutdown_connections 2023-11-24T07:57:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.730+0000 7f80adc17640 1 -- 172.21.15.5:0/516328868 wait complete. 2023-11-24T07:57:27.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 Processor -- start 2023-11-24T07:57:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 -- start start 2023-11-24T07:57:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb4c0cf1b0 0x7fdb4c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0cdfb0 con 0x7fdb4c15d8f0 2023-11-24T07:57:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c0d4420 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb544ea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0d4140 con 0x7fdb4c0ced30 2023-11-24T07:57:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb52a87640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb4c0cf1b0 0x7fdb4c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb52286640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdb4c15d8f0 0x7fdb4c15e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51990/0 (socket says 172.21.15.5:51990) 2023-11-24T07:57:27.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb52286640 1 -- 172.21.15.5:0/2082514268 learned_addr learned my addr 172.21.15.5:0/2082514268 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb51a85640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.894+0000 7fdb52a87640 1 -- 172.21.15.5:0/2082514268 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 msgr2=0x7fdb4c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb52a87640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb52a87640 1 -- 172.21.15.5:0/2082514268 >> v1:172.21.15.5:6789/0 conn(0x7fdb4c15d8f0 legacy=0x7fdb4c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb52a87640 1 -- 172.21.15.5:0/2082514268 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0ce250 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb51284640 1 -- 172.21.15.5:0/2082514268 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268113126 0 0) 0x7fdb4c0cdfb0 con 0x7fdb4c15d8f0 2023-11-24T07:57:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb51a85640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:27.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb52a87640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0d0340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009d90 tx=0x7fdb4401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb72bb0bc50b2ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb51284640 1 -- 172.21.15.5:0/2082514268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440a59e0 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb51284640 1 -- 172.21.15.5:0/2082514268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb440a5b40 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb51284640 1 -- 172.21.15.5:0/2082514268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440ad440 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 -- 172.21.15.5:0/2082514268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 msgr2=0x7fdb4c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0d0340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009d90 tx=0x7fdb4401c920 comp rx=0 tx=0).stop 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 -- 172.21.15.5:0/2082514268 shutdown_connections 2023-11-24T07:57:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0d0340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2082514268 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 -- 172.21.15.5:0/2082514268 >> 172.21.15.5:0/2082514268 conn(0x7fdb4c09c750 msgr2=0x7fdb4c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 -- 172.21.15.5:0/2082514268 shutdown_connections 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.898+0000 7fdb544ea640 1 -- 172.21.15.5:0/2082514268 wait complete. 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 Processor -- start 2023-11-24T07:57:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- start start 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb4c15d8f0 0x7fdb4c142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c155230 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c1545b0 con 0x7fdb4c15d8f0 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c154890 con 0x7fdb4c0ced30 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46708/0 (socket says 172.21.15.5:46708) 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 -- 172.21.15.5:0/2536345281 learned_addr learned my addr 172.21.15.5:0/2536345281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb52a87640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb4c15d8f0 0x7fdb4c142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb52286640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 -- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 msgr2=0x7fdb4c0b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 -- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb4c15d8f0 msgr2=0x7fdb4c142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb4c15d8f0 0x7fdb4c142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 -- 172.21.15.5:0/2536345281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009a70 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb51a85640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00d7d0 tx=0x7fdb3c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0096a0 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c009800 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c009bb0 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c154b70 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.902+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c1541f0 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.906+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c04e850 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.906+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb3c009d10 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.906+0000 7fdb42ffd640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 0x7fdb30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.906+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb3c084600 con 0x7fdb4c0cf1b0 2023-11-24T07:57:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.906+0000 7fdb52286640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 0x7fdb30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.910+0000 7fdb52286640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 0x7fdb30068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000f70 tx=0x7fdb48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:27.910+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb3c051a70 con 0x7fdb4c0cf1b0 2023-11-24T07:57:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.066+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb4c0cf9d0 con 0x7fdb4c0cf1b0 2023-11-24T07:57:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.066+0000 7fdb42ffd640 1 -- 172.21.15.5:0/2536345281 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb3c00b440 con 0x7fdb4c0cf1b0 2023-11-24T07:57:28.072 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 msgr2=0x7fdb30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 0x7fdb30068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000f70 tx=0x7fdb48009040 comp rx=0 tx=0).stop 2023-11-24T07:57:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 msgr2=0x7fdb4c0b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00d7d0 tx=0x7fdb3c00dc90 comp rx=0 tx=0).stop 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 shutdown_connections 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdb30066470 0x7fdb30068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb4c15d8f0 0x7fdb4c142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb4c0cf1b0 0x7fdb4c0b6520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 --2- 172.21.15.5:0/2536345281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb4c0ced30 0x7fdb4c0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 >> 172.21.15.5:0/2536345281 conn(0x7fdb4c09c750 msgr2=0x7fdb4c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 shutdown_connections 2023-11-24T07:57:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.070+0000 7fdb544ea640 1 -- 172.21.15.5:0/2536345281 wait complete. 2023-11-24T07:57:28.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 Processor -- start 2023-11-24T07:57:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 -- start start 2023-11-24T07:57:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 0x7fbe7015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe700d0510 0x7fbe700d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7015ecc0 con 0x7fbe700ced30 2023-11-24T07:57:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700d4420 con 0x7fbe700d0510 2023-11-24T07:57:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe75180640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700cdfb0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6f59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe700d0510 0x7fbe700d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6ed9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 0x7fbe7015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe67fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe700ced30 0x7fbe700cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:35754/0 (socket says 172.21.15.5:35754) 2023-11-24T07:57:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe67fff640 1 -- 172.21.15.5:0/621347043 learned_addr learned my addr 172.21.15.5:0/621347043 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6ed9d640 1 -- 172.21.15.5:0/621347043 >> v2:172.21.15.102:3300/0 conn(0x7fbe700d0510 msgr2=0x7fbe700d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6ed9d640 1 --2- 172.21.15.5:0/621347043 >> v2:172.21.15.102:3300/0 conn(0x7fbe700d0510 0x7fbe700d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6ed9d640 1 -- 172.21.15.5:0/621347043 >> v1:172.21.15.102:6789/0 conn(0x7fbe700ced30 legacy=0x7fbe700cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.234+0000 7fbe6ed9d640 1 -- 172.21.15.5:0/621347043 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700d4140 con 0x7fbe7015d8f0 2023-11-24T07:57:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe6ed9d640 1 --2- 172.21.15.5:0/621347043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 0x7fbe7015e780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe600097c0 tx=0x7fbe6001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25efc202a7c0567 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe6e59c640 1 -- 172.21.15.5:0/621347043 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600ad660 con 0x7fbe7015d8f0 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe6e59c640 1 -- 172.21.15.5:0/621347043 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe600ad7c0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe6e59c640 1 -- 172.21.15.5:0/621347043 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600adb50 con 0x7fbe7015d8f0 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe75180640 1 -- 172.21.15.5:0/621347043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 msgr2=0x7fbe7015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe75180640 1 --2- 172.21.15.5:0/621347043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 0x7fbe7015e780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe600097c0 tx=0x7fbe6001c450 comp rx=0 tx=0).stop 2023-11-24T07:57:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe75180640 1 -- 172.21.15.5:0/621347043 shutdown_connections 2023-11-24T07:57:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe75180640 1 --2- 172.21.15.5:0/621347043 >> v2:172.21.15.102:3300/0 conn(0x7fbe700d0510 0x7fbe700d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.238+0000 7fbe75180640 1 --2- 172.21.15.5:0/621347043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe7015d8f0 0x7fbe7015e780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- 172.21.15.5:0/621347043 >> 172.21.15.5:0/621347043 conn(0x7fbe7009c750 msgr2=0x7fbe700d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- 172.21.15.5:0/621347043 shutdown_connections 2023-11-24T07:57:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- 172.21.15.5:0/621347043 wait complete. 2023-11-24T07:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 Processor -- start 2023-11-24T07:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- start start 2023-11-24T07:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe700ced30 0x7fbe700b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe700d0510 0x7fbe700b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70154bb0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b92e0 con 0x7fbe700d0510 2023-11-24T07:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe75180640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b6180 con 0x7fbe700ced30 2023-11-24T07:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46718/0 (socket says 172.21.15.5:46718) 2023-11-24T07:57:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 -- 172.21.15.5:0/2383138894 learned_addr learned my addr 172.21.15.5:0/2383138894 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6ed9d640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe700ced30 0x7fbe700b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe67fff640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe700d0510 0x7fbe700b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 -- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe700ced30 msgr2=0x7fbe700b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe700ced30 0x7fbe700b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 -- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe700d0510 msgr2=0x7fbe700b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe700d0510 0x7fbe700b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 -- 172.21.15.5:0/2383138894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009420 con 0x7fbe7015d8f0 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.242+0000 7fbe6f59e640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800efc0 tx=0x7fbe6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68009ba0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800f040 con 0x7fbe7015d8f0 2023-11-24T07:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe700b6460 con 0x7fbe7015d8f0 2023-11-24T07:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680146c0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe70154820 con 0x7fbe7015d8f0 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700b10a0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe68014820 con 0x7fbe7015d8f0 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 0x7fbe50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe68084bd0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.246+0000 7fbe6ed9d640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 0x7fbe50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.250+0000 7fbe6ed9d640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 0x7fbe50068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe600af000 tx=0x7fbe600a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.250+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe700b10a0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.418+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe700b10a0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.418+0000 7fbe677fe640 1 -- 172.21.15.5:0/2383138894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe700b10a0 con 0x7fbe7015d8f0 2023-11-24T07:57:28.424 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 msgr2=0x7fbe50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 0x7fbe50068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe600af000 tx=0x7fbe600a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 msgr2=0x7fbe700b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800efc0 tx=0x7fbe6800c490 comp rx=0 tx=0).stop 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 shutdown_connections 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbe50066470 0x7fbe50068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe7015d8f0 0x7fbe700b1380 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe700d0510 0x7fbe700b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 --2- 172.21.15.5:0/2383138894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe700ced30 0x7fbe700b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 >> 172.21.15.5:0/2383138894 conn(0x7fbe7009c750 msgr2=0x7fbe7015dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 shutdown_connections 2023-11-24T07:57:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.422+0000 7fbe75180640 1 -- 172.21.15.5:0/2383138894 wait complete. 2023-11-24T07:57:28.445 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T07:57:28.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:28.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T07:57:28.473 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:57:28.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:28.473 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T07:57:28.529 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T07:57:28.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.666+0000 7f71fa617640 1 Processor -- start 2023-11-24T07:57:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.666+0000 7f71fa617640 1 -- start start 2023-11-24T07:57:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71fa617640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71f40abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71fa617640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71f4070df0 0x7f71f406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71fa617640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f4145060 con 0x7f71f40ac460 2023-11-24T07:57:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71fa617640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4071250 con 0x7f71f4070df0 2023-11-24T07:57:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71fa617640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071fd0 con 0x7f71f4144c80 2023-11-24T07:57:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f71f40ac460 0x7f71f40706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52002/0 (socket says 172.21.15.5:52002) 2023-11-24T07:57:28.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f37fe640 1 -- 172.21.15.5:0/3683664035 learned_addr learned my addr 172.21.15.5:0/3683664035 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71f40abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f8bb4640 1 --2- 172.21.15.5:0/3683664035 >> v2:172.21.15.102:3300/0 conn(0x7f71f4070df0 0x7f71f406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300593097 0 0) 0x7f71f4145060 con 0x7f71f40ac460 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc003530 con 0x7f71f40ac460 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928643066 0 0) 0x7f71dc003530 con 0x7f71f40ac460 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 msgr2=0x7f71f40abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71f40abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 >> v2:172.21.15.102:3300/0 conn(0x7f71f4070df0 msgr2=0x7f71f406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/3683664035 >> v2:172.21.15.102:3300/0 conn(0x7f71f4070df0 0x7f71f406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40ac8c0 con 0x7f71f40ac460 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f71e8001680 con 0x7f71f40ac460 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 >> v1:172.21.15.5:6789/0 conn(0x7f71f40ac460 legacy=0x7f71f40706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71dc003980 0x7f71dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71dc004d10 0x7f71dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071250 con 0x7f71dc003980 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071fd0 con 0x7f71dc004d10 2023-11-24T07:57:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc00b990 con 0x7f71f4144c80 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71dc003980 0x7f71dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f37fe640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f8bb4640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71dc004d10 0x7f71dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 -- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 msgr2=0x7f71dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71f4144c80 0x7f71dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 -- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71dc004d10 msgr2=0x7f71dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71dc004d10 0x7f71dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f3fff640 1 -- 172.21.15.5:0/3683664035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc003530 con 0x7f71dc003980 2023-11-24T07:57:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.670+0000 7f71f8bb4640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71dc004d10 0x7f71dc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71f3fff640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71dc003980 0x7f71dc003da0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009ae0 tx=0x7f71e401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb237459dcd3bbc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40a6510 con 0x7f71dc003980 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40a6670 con 0x7f71dc003980 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71f2ffd640 1 -- 172.21.15.5:0/3683664035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40a6a20 con 0x7f71dc003980 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 -- 172.21.15.5:0/3683664035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71dc003980 msgr2=0x7f71dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 --2- 172.21.15.5:0/3683664035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71dc003980 0x7f71dc003da0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009ae0 tx=0x7f71e401ca20 comp rx=0 tx=0).stop 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71f8bb4640 1 -- 172.21.15.5:0/3683664035 reap_dead start 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 -- 172.21.15.5:0/3683664035 shutdown_connections 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 -- 172.21.15.5:0/3683664035 >> 172.21.15.5:0/3683664035 conn(0x7f71f40b0c40 msgr2=0x7f71f40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 -- 172.21.15.5:0/3683664035 shutdown_connections 2023-11-24T07:57:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.674+0000 7f71fa617640 1 -- 172.21.15.5:0/3683664035 wait complete. 2023-11-24T07:57:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 Processor -- start 2023-11-24T07:57:28.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- start start 2023-11-24T07:57:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 0x7f71f41fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40b2f90 0x7f71f409a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b3440 con 0x7f71f41fd990 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b3710 con 0x7f71f40b2f90 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b39f0 con 0x7f71dc003980 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46736/0 (socket says 172.21.15.5:46736) 2023-11-24T07:57:28.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f37fe640 1 -- 172.21.15.5:0/4251134109 learned_addr learned my addr 172.21.15.5:0/4251134109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 0x7f71f41fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f8bb4640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40b2f90 0x7f71f409a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 -- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40b2f90 msgr2=0x7f71f409a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40b2f90 0x7f71f409a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 -- 172.21.15.5:0/4251134109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 msgr2=0x7f71f40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 -- 172.21.15.5:0/4251134109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4099bd0 con 0x7f71dc003980 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f37fe640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f3fff640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 0x7f71f41fd450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71e40ac000 tx=0x7f71dc005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400f000 con 0x7f71dc003980 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4004020 con 0x7f71dc003980 2023-11-24T07:57:28.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004390 con 0x7f71dc003980 2023-11-24T07:57:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f4099eb0 con 0x7f71dc003980 2023-11-24T07:57:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.678+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f409aae0 con 0x7f71dc003980 2023-11-24T07:57:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f40b1ba0 con 0x7f71dc003980 2023-11-24T07:57:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71e40a67e0 con 0x7f71dc003980 2023-11-24T07:57:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71f0ff9640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 0x7f71e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e40aa070 con 0x7f71dc003980 2023-11-24T07:57:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71f37fe640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 0x7f71e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.682+0000 7f71f37fe640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 0x7f71e0068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71f409cac0 tx=0x7f71e8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.686+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71e40eb9e0 con 0x7f71dc003980 2023-11-24T07:57:28.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.874+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71f4099a30 con 0x7f71dc003980 2023-11-24T07:57:28.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71f0ff9640 1 -- 172.21.15.5:0/4251134109 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f71f4099a30 con 0x7f71dc003980 2023-11-24T07:57:28.881 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:28.881 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:28.881 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 msgr2=0x7f71e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 0x7f71e0068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71f409cac0 tx=0x7f71e8007040 comp rx=0 tx=0).stop 2023-11-24T07:57:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 msgr2=0x7f71f41fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 0x7f71f41fd450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71e40ac000 tx=0x7f71dc005800 comp rx=0 tx=0).stop 2023-11-24T07:57:28.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 shutdown_connections 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f71e0066470 0x7f71e0068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40b2f90 0x7f71f409a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71f41fd990 0x7f71f40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 --2- 172.21.15.5:0/4251134109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71dc003980 0x7f71f41fd450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 >> 172.21.15.5:0/4251134109 conn(0x7f71f40b0c40 msgr2=0x7f71f40aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 shutdown_connections 2023-11-24T07:57:28.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:28.878+0000 7f71fa617640 1 -- 172.21.15.5:0/4251134109 wait complete. 2023-11-24T07:57:28.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 Processor -- start 2023-11-24T07:57:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 -- start start 2023-11-24T07:57:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f534c15d7b0 0x7f534c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f534c0cead0 0x7f534c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0d22c0 con 0x7f534c0d1eb0 2023-11-24T07:57:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0cefd0 con 0x7f534c0cead0 2023-11-24T07:57:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5354757640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0cf2b0 con 0x7f534c15d7b0 2023-11-24T07:57:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f534c0cead0 0x7f534c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f534c0cead0 0x7f534c0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46738/0 (socket says 172.21.15.5:46738) 2023-11-24T07:57:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 -- 172.21.15.5:0/492775751 learned_addr learned my addr 172.21.15.5:0/492775751 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 -- 172.21.15.5:0/492775751 >> v2:172.21.15.102:3300/0 conn(0x7f534c15d7b0 msgr2=0x7f534c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 --2- 172.21.15.5:0/492775751 >> v2:172.21.15.102:3300/0 conn(0x7f534c15d7b0 0x7f534c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 -- 172.21.15.5:0/492775751 >> v1:172.21.15.102:6789/0 conn(0x7f534c0d1eb0 legacy=0x7f534c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.046+0000 7f5351cf2640 1 -- 172.21.15.5:0/492775751 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c06b3f0 con 0x7f534c0cead0 2023-11-24T07:57:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5351cf2640 1 --2- 172.21.15.5:0/492775751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c0d1970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f534c0d3310 tx=0x7f533c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49eba7a0f51af70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f53514f1640 1 -- 172.21.15.5:0/492775751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ab600 con 0x7f534c0cead0 2023-11-24T07:57:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f53514f1640 1 -- 172.21.15.5:0/492775751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0a7050 con 0x7f534c0cead0 2023-11-24T07:57:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f53514f1640 1 -- 172.21.15.5:0/492775751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ab980 con 0x7f534c0cead0 2023-11-24T07:57:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 -- 172.21.15.5:0/492775751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 msgr2=0x7f534c0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 --2- 172.21.15.5:0/492775751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c0d1970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f534c0d3310 tx=0x7f533c01c370 comp rx=0 tx=0).stop 2023-11-24T07:57:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 -- 172.21.15.5:0/492775751 shutdown_connections 2023-11-24T07:57:29.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 --2- 172.21.15.5:0/492775751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c0d1970 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 --2- 172.21.15.5:0/492775751 >> v2:172.21.15.102:3300/0 conn(0x7f534c15d7b0 0x7f534c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 -- 172.21.15.5:0/492775751 >> 172.21.15.5:0/492775751 conn(0x7f534c0d33b0 msgr2=0x7f534c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 -- 172.21.15.5:0/492775751 shutdown_connections 2023-11-24T07:57:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 -- 172.21.15.5:0/492775751 wait complete. 2023-11-24T07:57:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.050+0000 7f5354757640 1 Processor -- start 2023-11-24T07:57:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- start start 2023-11-24T07:57:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534c0d1eb0 0x7f534c0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f534c15d7b0 0x7f534c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0cc6f0 con 0x7f534c0cead0 2023-11-24T07:57:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0cbb20 con 0x7f534c15d7b0 2023-11-24T07:57:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c153e90 con 0x7f534c0d1eb0 2023-11-24T07:57:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46746/0 (socket says 172.21.15.5:46746) 2023-11-24T07:57:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 -- 172.21.15.5:0/1725143367 learned_addr learned my addr 172.21.15.5:0/1725143367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5352cf4640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f534c15d7b0 0x7f534c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5351cf2640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534c0d1eb0 0x7f534c0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 -- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534c0d1eb0 msgr2=0x7f534c0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534c0d1eb0 0x7f534c0ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 -- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f534c15d7b0 msgr2=0x7f534c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f534c15d7b0 0x7f534c15ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 -- 172.21.15.5:0/1725143367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0094d0 con 0x7f534c0cead0 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f53524f3640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f534800b410 tx=0x7f534800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348011830 con 0x7f534c0cead0 2023-11-24T07:57:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5348011990 con 0x7f534c0cead0 2023-11-24T07:57:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348011d40 con 0x7f534c0cead0 2023-11-24T07:57:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0cbd50 con 0x7f534c0cead0 2023-11-24T07:57:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c0cc310 con 0x7f534c0cead0 2023-11-24T07:57:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.054+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c04e850 con 0x7f534c0cead0 2023-11-24T07:57:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.058+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f534801a400 con 0x7f534c0cead0 2023-11-24T07:57:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.058+0000 7f5342ffd640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.058+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5348083f60 con 0x7f534c0cead0 2023-11-24T07:57:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.058+0000 7f5351cf2640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.058+0000 7f5351cf2640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ad000 tx=0x7f533c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.062+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53480513f0 con 0x7f534c0cead0 2023-11-24T07:57:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.222+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f534c0c6850 con 0x7f534c0cead0 2023-11-24T07:57:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.222+0000 7f5342ffd640 1 -- 172.21.15.5:0/1725143367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f5348015090 con 0x7f534c0cead0 2023-11-24T07:57:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:29.228 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:56:50.978562+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 msgr2=0x7f5330068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ad000 tx=0x7f533c0a6000 comp rx=0 tx=0).stop 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 msgr2=0x7f534c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f534800b410 tx=0x7f534800b8d0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 shutdown_connections 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f534c15d7b0 0x7f534c15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534c0d1eb0 0x7f534c0ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 --2- 172.21.15.5:0/1725143367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f534c0cead0 0x7f534c153590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 >> 172.21.15.5:0/1725143367 conn(0x7f534c0d33b0 msgr2=0x7f534c0d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 shutdown_connections 2023-11-24T07:57:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.226+0000 7f5354757640 1 -- 172.21.15.5:0/1725143367 wait complete. 2023-11-24T07:57:29.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:56:47.343209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:56:48.359794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:29.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 Processor -- start 2023-11-24T07:57:29.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 -- start start 2023-11-24T07:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ac40b4040 0x7f5ac40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ac4162190 0x7f5ac4162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40b2590 con 0x7f5ac4162190 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40b2870 con 0x7f5ac40b4040 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.390+0000 7f5acb3c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40b2b50 con 0x7f5ac40b3c60 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ac4162190 0x7f5ac4162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ac4162190 0x7f5ac4162600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46754/0 (socket says 172.21.15.5:46754) 2023-11-24T07:57:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 -- 172.21.15.5:0/2679188708 learned_addr learned my addr 172.21.15.5:0/2679188708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac915d640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac895c640 1 --2- 172.21.15.5:0/2679188708 >> v2:172.21.15.102:3300/0 conn(0x7f5ac40b4040 0x7f5ac40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 -- 172.21.15.5:0/2679188708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 msgr2=0x7f5ac40b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac40b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 -- 172.21.15.5:0/2679188708 >> v2:172.21.15.102:3300/0 conn(0x7f5ac40b4040 msgr2=0x7f5ac40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2679188708 >> v2:172.21.15.102:3300/0 conn(0x7f5ac40b4040 0x7f5ac40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 -- 172.21.15.5:0/2679188708 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40b2e30 con 0x7f5ac4162190 2023-11-24T07:57:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac4162190 0x7f5ac4162600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac406c270 tx=0x7f5abc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd1a1f5f87d292e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5abbfff640 1 -- 172.21.15.5:0/2679188708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a57b0 con 0x7f5ac4162190 2023-11-24T07:57:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5abbfff640 1 -- 172.21.15.5:0/2679188708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0a5910 con 0x7f5ac4162190 2023-11-24T07:57:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.394+0000 7f5abbfff640 1 -- 172.21.15.5:0/2679188708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a5ca0 con 0x7f5ac4162190 2023-11-24T07:57:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2679188708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac4162190 msgr2=0x7f5ac4162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac4162190 0x7f5ac4162600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac406c270 tx=0x7f5abc01c9a0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2679188708 shutdown_connections 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac4162190 0x7f5ac4162600 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2679188708 >> v2:172.21.15.102:3300/0 conn(0x7f5ac40b4040 0x7f5ac40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2679188708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac40b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2679188708 >> 172.21.15.5:0/2679188708 conn(0x7f5ac40b0cb0 msgr2=0x7f5ac40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2679188708 shutdown_connections 2023-11-24T07:57:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2679188708 wait complete. 2023-11-24T07:57:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 Processor -- start 2023-11-24T07:57:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- start start 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac4162190 0x7f5ac40af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40b0120 con 0x7f5ac40afc90 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415b330 con 0x7f5ac4162190 2023-11-24T07:57:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5acb3c1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415b610 con 0x7f5ac40b3c60 2023-11-24T07:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5ac995e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5ac995e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46760/0 (socket says 172.21.15.5:46760) 2023-11-24T07:57:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.398+0000 7f5ac995e640 1 -- 172.21.15.5:0/2991253786 learned_addr learned my addr 172.21.15.5:0/2991253786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac915d640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac4156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac895c640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac4162190 0x7f5ac40af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 -- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 msgr2=0x7f5ac4156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac4156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 -- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac4162190 msgr2=0x7f5ac40af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac4162190 0x7f5ac40af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 -- 172.21.15.5:0/2991253786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc009b30 con 0x7f5ac40afc90 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ac995e640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0af040 tx=0x7f5abc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b8670 con 0x7f5ac40afc90 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0b87d0 con 0x7f5ac40afc90 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b8b80 con 0x7f5ac40afc90 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac415b8f0 con 0x7f5ac40afc90 2023-11-24T07:57:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac415beb0 con 0x7f5ac40afc90 2023-11-24T07:57:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40671f0 con 0x7f5ac40afc90 2023-11-24T07:57:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.402+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5abc0b8ce0 con 0x7f5ac40afc90 2023-11-24T07:57:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.406+0000 7f5ab9ffb640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 0x7f5aa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.406+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5abc11ec80 con 0x7f5ac40afc90 2023-11-24T07:57:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.406+0000 7f5ac915d640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 0x7f5aa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.406+0000 7f5ac915d640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 0x7f5aa8068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ce980 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.410+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5abc0ec0e0 con 0x7f5ac40afc90 2023-11-24T07:57:29.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.566+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ac406b460 con 0x7f5ac40afc90 2023-11-24T07:57:29.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.566+0000 7f5ab9ffb640 1 -- 172.21.15.5:0/2991253786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5abc009510 con 0x7f5ac40afc90 2023-11-24T07:57:29.572 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 msgr2=0x7f5aa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 0x7f5aa8068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ce980 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 msgr2=0x7f5ac415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0af040 tx=0x7f5abc019740 comp rx=0 tx=0).stop 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 shutdown_connections 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f5aa80664a0 0x7f5aa8068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac40afc90 0x7f5ac415d250 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac4162190 0x7f5ac40af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 --2- 172.21.15.5:0/2991253786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ac40b3c60 0x7f5ac4156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 >> 172.21.15.5:0/2991253786 conn(0x7f5ac40b0cb0 msgr2=0x7f5ac40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 shutdown_connections 2023-11-24T07:57:29.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.570+0000 7f5acb3c1640 1 -- 172.21.15.5:0/2991253786 wait complete. 2023-11-24T07:57:29.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.734+0000 7fcab6f10640 1 Processor -- start 2023-11-24T07:57:29.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.734+0000 7fcab6f10640 1 -- start start 2023-11-24T07:57:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab6f10640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab6f10640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab00b8bd0 0x7fcab015d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab6f10640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00cfab0 con 0x7fcab00d1b20 2023-11-24T07:57:29.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab6f10640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab015e260 con 0x7fcab00b8bd0 2023-11-24T07:57:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab6f10640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab015e540 con 0x7fcab015d3b0 2023-11-24T07:57:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab00b8bd0 0x7fcab015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcab00b8bd0 0x7fcab015d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46766/0 (socket says 172.21.15.5:46766) 2023-11-24T07:57:29.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 -- 172.21.15.5:0/1712581303 learned_addr learned my addr 172.21.15.5:0/1712581303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab5f0e640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 -- 172.21.15.5:0/1712581303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 msgr2=0x7fcab00d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 -- 172.21.15.5:0/1712581303 >> v1:172.21.15.102:6789/0 conn(0x7fcab00d1b20 legacy=0x7fcab00d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 -- 172.21.15.5:0/1712581303 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00cfd20 con 0x7fcab00b8bd0 2023-11-24T07:57:29.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.738+0000 7fcab570d640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00b8bd0 0x7fcab015d790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0006fd0 tx=0x7fcaa001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4303e5925dd4ced server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab4f0c640 1 -- 172.21.15.5:0/1712581303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00a9400 con 0x7fcab00b8bd0 2023-11-24T07:57:29.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab4f0c640 1 -- 172.21.15.5:0/1712581303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa00a9560 con 0x7fcab00b8bd0 2023-11-24T07:57:29.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab4f0c640 1 -- 172.21.15.5:0/1712581303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00a98f0 con 0x7fcab00b8bd0 2023-11-24T07:57:29.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- 172.21.15.5:0/1712581303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00b8bd0 msgr2=0x7fcab015d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00b8bd0 0x7fcab015d790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0006fd0 tx=0x7fcaa001c520 comp rx=0 tx=0).stop 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- 172.21.15.5:0/1712581303 shutdown_connections 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00b8bd0 0x7fcab015d790 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- 172.21.15.5:0/1712581303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- 172.21.15.5:0/1712581303 >> 172.21.15.5:0/1712581303 conn(0x7fcab00666a0 msgr2=0x7fcab0066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- 172.21.15.5:0/1712581303 shutdown_connections 2023-11-24T07:57:29.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- 172.21.15.5:0/1712581303 wait complete. 2023-11-24T07:57:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 Processor -- start 2023-11-24T07:57:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- start start 2023-11-24T07:57:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab00b8bd0 0x7fcab00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c8a00 con 0x7fcab00d1b20 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c7df0 con 0x7fcab00b8bd0 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab6f10640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c80d0 con 0x7fcab015d3b0 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.742+0000 7fcab570d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46778/0 (socket says 172.21.15.5:46778) 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 -- 172.21.15.5:0/4089721533 learned_addr learned my addr 172.21.15.5:0/4089721533 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab5f0e640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab00b8bd0 0x7fcab00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab670f640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 -- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 msgr2=0x7fcab00ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 -- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab00b8bd0 msgr2=0x7fcab00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab00b8bd0 0x7fcab00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 -- 172.21.15.5:0/4089721533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa0009480 con 0x7fcab00d1b20 2023-11-24T07:57:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab570d640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0006fd0 tx=0x7fcaa00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0005ba0 con 0x7fcab00d1b20 2023-11-24T07:57:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa00b5070 con 0x7fcab00d1b20 2023-11-24T07:57:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab00c83b0 con 0x7fcab00d1b20 2023-11-24T07:57:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00a98e0 con 0x7fcab00d1b20 2023-11-24T07:57:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab01543f0 con 0x7fcab00d1b20 2023-11-24T07:57:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0073d80 con 0x7fcab00d1b20 2023-11-24T07:57:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcaa00a9a40 con 0x7fcab00d1b20 2023-11-24T07:57:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.746+0000 7fcaa67fc640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 0x7fca94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.750+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa00b7070 con 0x7fcab00d1b20 2023-11-24T07:57:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.750+0000 7fcab5f0e640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 0x7fca94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.750+0000 7fcab5f0e640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 0x7fca94068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009ac0 tx=0x7fcaac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.750+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcaa00eb010 con 0x7fcab00d1b20 2023-11-24T07:57:29.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcab00c8210 con 0x7fcab00d1b20 2023-11-24T07:57:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcaa67fc640 1 -- 172.21.15.5:0/4089721533 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcab00c8210 con 0x7fcab00d1b20 2023-11-24T07:57:29.914 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 msgr2=0x7fca94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 0x7fca94068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009ac0 tx=0x7fcaac009190 comp rx=0 tx=0).stop 2023-11-24T07:57:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 msgr2=0x7fcab0153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0006fd0 tx=0x7fcaa00192c0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 shutdown_connections 2023-11-24T07:57:29.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fca94066470 0x7fca94068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcab015d3b0 0x7fcab00ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcab00d1b20 0x7fcab0153eb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 --2- 172.21.15.5:0/4089721533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab00b8bd0 0x7fcab00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 >> 172.21.15.5:0/4089721533 conn(0x7fcab00666a0 msgr2=0x7fcab0159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 shutdown_connections 2023-11-24T07:57:29.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:29.910+0000 7fcab6f10640 1 -- 172.21.15.5:0/4089721533 wait complete. 2023-11-24T07:57:29.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.078+0000 7fe3b01df640 1 Processor -- start 2023-11-24T07:57:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.078+0000 7fe3b01df640 1 -- start start 2023-11-24T07:57:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3b01df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3a80b4040 0x7fe3a80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3b01df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3b01df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a80b2590 con 0x7fe3a80b3c60 2023-11-24T07:57:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3b01df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a80b2870 con 0x7fe3a80b4040 2023-11-24T07:57:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3b01df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80b2b50 con 0x7fe3a8162190 2023-11-24T07:57:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3adf7b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe3a80b3c60 0x7fe3a80ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:35784/0 (socket says 172.21.15.5:35784) 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3adf7b640 1 -- 172.21.15.5:0/1464126749 learned_addr learned my addr 172.21.15.5:0/1464126749 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:43312/0 (socket says 172.21.15.5:43312) 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ad77a640 1 --2- 172.21.15.5:0/1464126749 >> v2:172.21.15.102:3300/0 conn(0x7fe3a80b4040 0x7fe3a80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 -- 172.21.15.5:0/1464126749 >> v2:172.21.15.102:3300/0 conn(0x7fe3a80b4040 msgr2=0x7fe3a80b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3acf79640 1 -- 172.21.15.5:0/1464126749 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341988816 0 0) 0x7fe3a80b2590 con 0x7fe3a80b3c60 2023-11-24T07:57:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 --2- 172.21.15.5:0/1464126749 >> v2:172.21.15.102:3300/0 conn(0x7fe3a80b4040 0x7fe3a80b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 -- 172.21.15.5:0/1464126749 >> v1:172.21.15.102:6789/0 conn(0x7fe3a80b3c60 legacy=0x7fe3a80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.082+0000 7fe3ae77c640 1 -- 172.21.15.5:0/1464126749 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a80b2e30 con 0x7fe3a8162190 2023-11-24T07:57:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3ae77c640 1 --2- 172.21.15.5:0/1464126749 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009d90 tx=0x7fe3a001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c7d722acdcdd41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3acf79640 1 -- 172.21.15.5:0/1464126749 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00a5a00 con 0x7fe3a8162190 2023-11-24T07:57:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3acf79640 1 -- 172.21.15.5:0/1464126749 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00a5b60 con 0x7fe3a8162190 2023-11-24T07:57:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3acf79640 1 -- 172.21.15.5:0/1464126749 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00ad440 con 0x7fe3a8162190 2023-11-24T07:57:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- 172.21.15.5:0/1464126749 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 msgr2=0x7fe3a81625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 --2- 172.21.15.5:0/1464126749 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009d90 tx=0x7fe3a001c920 comp rx=0 tx=0).stop 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- 172.21.15.5:0/1464126749 shutdown_connections 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 --2- 172.21.15.5:0/1464126749 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a81625e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 --2- 172.21.15.5:0/1464126749 >> v2:172.21.15.102:3300/0 conn(0x7fe3a80b4040 0x7fe3a80b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- 172.21.15.5:0/1464126749 >> 172.21.15.5:0/1464126749 conn(0x7fe3a80b0cb0 msgr2=0x7fe3a80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- 172.21.15.5:0/1464126749 shutdown_connections 2023-11-24T07:57:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- 172.21.15.5:0/1464126749 wait complete. 2023-11-24T07:57:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 Processor -- start 2023-11-24T07:57:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.086+0000 7fe3b01df640 1 -- start start 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a80b3c60 0x7fe3a8144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a8164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8164b50 con 0x7fe3a81443a0 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81452e0 con 0x7fe3a80b3c60 2023-11-24T07:57:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81455c0 con 0x7fe3a8162190 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46790/0 (socket says 172.21.15.5:46790) 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 -- 172.21.15.5:0/3437805640 learned_addr learned my addr 172.21.15.5:0/3437805640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ad77a640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a8164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3adf7b640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a80b3c60 0x7fe3a8144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 -- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 msgr2=0x7fe3a8164610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a8164610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 -- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a80b3c60 msgr2=0x7fe3a8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a80b3c60 0x7fe3a8144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 -- 172.21.15.5:0/3437805640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009a70 con 0x7fe3a81443a0 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3ae77c640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3a001afd0 tx=0x7fe3a00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00a5a00 con 0x7fe3a81443a0 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0009450 con 0x7fe3a81443a0 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00b7610 con 0x7fe3a81443a0 2023-11-24T07:57:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a81458a0 con 0x7fe3a81443a0 2023-11-24T07:57:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a8145e60 con 0x7fe3a81443a0 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80671f0 con 0x7fe3a81443a0 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.090+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3a00b4050 con 0x7fe3a81443a0 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.094+0000 7fe39e7fc640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.094+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3a011f5b0 con 0x7fe3a81443a0 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.094+0000 7fe3adf7b640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.094+0000 7fe3adf7b640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 0x7fe38c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a4007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.098+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3a00ecb50 con 0x7fe3a81443a0 2023-11-24T07:57:30.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.258+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3a806b460 con 0x7fe3a81443a0 2023-11-24T07:57:30.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe39e7fc640 1 -- 172.21.15.5:0/3437805640 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3a00f0170 con 0x7fe3a81443a0 2023-11-24T07:57:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 msgr2=0x7fe38c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 0x7fe38c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a4007d60 comp rx=0 tx=0).stop 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 msgr2=0x7fe3a8146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3a001afd0 tx=0x7fe3a00196c0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 shutdown_connections 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3a81443a0 0x7fe3a8146380 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3a8162190 0x7fe3a8164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 --2- 172.21.15.5:0/3437805640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a80b3c60 0x7fe3a8144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 >> 172.21.15.5:0/3437805640 conn(0x7fe3a80b0cb0 msgr2=0x7fe3a806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 shutdown_connections 2023-11-24T07:57:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.262+0000 7fe3b01df640 1 -- 172.21.15.5:0/3437805640 wait complete. 2023-11-24T07:57:30.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 Processor -- start 2023-11-24T07:57:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 -- start start 2023-11-24T07:57:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62400d2080 0x7f6240168160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cefd0 con 0x7f62400cead0 2023-11-24T07:57:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cf2b0 con 0x7f624015d7b0 2023-11-24T07:57:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f624658d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400d17e0 con 0x7f62400d2080 2023-11-24T07:57:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62400cead0 0x7f62400d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52018/0 (socket says 172.21.15.5:52018) 2023-11-24T07:57:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623f7fe640 1 -- 172.21.15.5:0/374532930 learned_addr learned my addr 172.21.15.5:0/374532930 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f6244b2a640 1 --2- 172.21.15.5:0/374532930 >> v2:172.21.15.102:3300/0 conn(0x7f62400d2080 0x7f6240168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167039070 0 0) 0x7f62400cefd0 con 0x7f62400cead0 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6228003530 con 0x7f62400cead0 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1997645822 0 0) 0x7f6228003530 con 0x7f62400cead0 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 >> v2:172.21.15.102:3300/0 conn(0x7f62400d2080 msgr2=0x7f6240168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 --2- 172.21.15.5:0/374532930 >> v2:172.21.15.102:3300/0 conn(0x7f62400d2080 0x7f6240168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 >> v1:172.21.15.102:6789/0 conn(0x7f624015d7b0 legacy=0x7f62400d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624006b3f0 con 0x7f62400cead0 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f6234001680 con 0x7f62400cead0 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 >> v1:172.21.15.5:6789/0 conn(0x7f62400cead0 legacy=0x7f62400d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6228003980 0x7f6228003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 0x7f6228004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62280052b0 0x7f622800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400d17e0 con 0x7f62280047d0 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622800c180 con 0x7f62280052b0 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622800c340 con 0x7f6228003980 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623f7fe640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 0x7f6228004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f623ffff640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6228003980 0x7f6228003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.426+0000 7f6244b2a640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62280052b0 0x7f622800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 -- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6228003980 msgr2=0x7f6228003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6228003980 0x7f6228003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 -- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62280052b0 msgr2=0x7f622800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62280052b0 0x7f622800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 -- 172.21.15.5:0/374532930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228003530 con 0x7f62280047d0 2023-11-24T07:57:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f6244b2a640 1 -- 172.21.15.5:0/374532930 reap_dead start 2023-11-24T07:57:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623f7fe640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 0x7f6228004c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62400cef00 tx=0x7f623401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf208d0c6798fc5a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234005ae0 con 0x7f62280047d0 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234005c40 con 0x7f62280047d0 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f623effd640 1 -- 172.21.15.5:0/374532930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340072b0 con 0x7f62280047d0 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f624658d640 1 -- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 msgr2=0x7f6228004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f624658d640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 0x7f6228004c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62400cef00 tx=0x7f623401cb30 comp rx=0 tx=0).stop 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f624658d640 1 -- 172.21.15.5:0/374532930 shutdown_connections 2023-11-24T07:57:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f624658d640 1 --2- 172.21.15.5:0/374532930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62280047d0 0x7f6228004c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.430+0000 7f624658d640 1 -- 172.21.15.5:0/374532930 >> 172.21.15.5:0/374532930 conn(0x7f62400d33b0 msgr2=0x7f62400d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- 172.21.15.5:0/374532930 shutdown_connections 2023-11-24T07:57:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- 172.21.15.5:0/374532930 wait complete. 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 Processor -- start 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- start start 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 0x7f62400c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbf40 0x7f62400cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cc900 con 0x7f6240157410 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c78f0 con 0x7f62400cbf40 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f624658d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c97a0 con 0x7f62280047d0 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 -- 172.21.15.5:0/955312251 learned_addr learned my addr 172.21.15.5:0/955312251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623ffff640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 0x7f62400c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f6244b2a640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbf40 0x7f62400cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 -- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 msgr2=0x7f62400c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 0x7f62400c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 -- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbf40 msgr2=0x7f62400cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbf40 0x7f62400cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 -- 172.21.15.5:0/955312251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400c7b40 con 0x7f6240157410 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623ffff640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 0x7f62400c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.434+0000 7f623f7fe640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623401c960 tx=0x7f6228005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340b4070 con 0x7f6240157410 2023-11-24T07:57:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234001480 con 0x7f6240157410 2023-11-24T07:57:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234007070 con 0x7f6240157410 2023-11-24T07:57:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400c7e20 con 0x7f6240157410 2023-11-24T07:57:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400c83e0 con 0x7f6240157410 2023-11-24T07:57:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624004e850 con 0x7f6240157410 2023-11-24T07:57:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62340071d0 con 0x7f6240157410 2023-11-24T07:57:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 0x7f622c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f623411d9a0 con 0x7f6240157410 2023-11-24T07:57:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.438+0000 7f623ffff640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 0x7f622c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.442+0000 7f623ffff640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 0x7f622c068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6230000c10 tx=0x7f6230009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.442+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62340ead00 con 0x7f6240157410 2023-11-24T07:57:30.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6240157890 con 0x7f6240157410 2023-11-24T07:57:30.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f623cff9640 1 -- 172.21.15.5:0/955312251 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f62340ee320 con 0x7f6240157410 2023-11-24T07:57:30.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:30.639 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:30.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 msgr2=0x7f622c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 0x7f622c068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6230000c10 tx=0x7f6230009040 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 msgr2=0x7f62400c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623401c960 tx=0x7f6228005800 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 shutdown_connections 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f622c066470 0x7f622c068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbf40 0x7f62400cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6240157410 0x7f62400c9260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 --2- 172.21.15.5:0/955312251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62280047d0 0x7f62400c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.634+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 >> 172.21.15.5:0/955312251 conn(0x7f62400d33b0 msgr2=0x7f62400b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.638+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 shutdown_connections 2023-11-24T07:57:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.638+0000 7f624658d640 1 -- 172.21.15.5:0/955312251 wait complete. 2023-11-24T07:57:30.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 Processor -- start 2023-11-24T07:57:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 -- start start 2023-11-24T07:57:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f880ac630 0x7f2f880706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f88070c20 0x7f2f8806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f88145060 con 0x7f2f88144c80 2023-11-24T07:57:30.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f88071fd0 con 0x7f2f880ac630 2023-11-24T07:57:30.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f8defe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f88071450 con 0x7f2f88070c20 2023-11-24T07:57:30.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f7ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f880ac630 0x7f2f880706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f7ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f880ac630 0x7f2f880706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46810/0 (socket says 172.21.15.5:46810) 2023-11-24T07:57:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.798+0000 7f2f7ffff640 1 -- 172.21.15.5:0/268863012 learned_addr learned my addr 172.21.15.5:0/268863012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f87fff640 1 --2- 172.21.15.5:0/268863012 >> v2:172.21.15.102:3300/0 conn(0x7f2f88070c20 0x7f2f8806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f7ffff640 1 -- 172.21.15.5:0/268863012 >> v2:172.21.15.102:3300/0 conn(0x7f2f88070c20 msgr2=0x7f2f8806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f7ffff640 1 --2- 172.21.15.5:0/268863012 >> v2:172.21.15.102:3300/0 conn(0x7f2f88070c20 0x7f2f8806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f7ffff640 1 -- 172.21.15.5:0/268863012 >> v1:172.21.15.102:6789/0 conn(0x7f2f88144c80 legacy=0x7f2f880abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f7ffff640 1 -- 172.21.15.5:0/268863012 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88071730 con 0x7f2f880ac630 2023-11-24T07:57:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f7ffff640 1 --2- 172.21.15.5:0/268863012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f880ac630 0x7f2f880706e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f880ce840 tx=0x7f2f7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d3aae995a59d7b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f86ffd640 1 -- 172.21.15.5:0/268863012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700aa430 con 0x7f2f880ac630 2023-11-24T07:57:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f86ffd640 1 -- 172.21.15.5:0/268863012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700aa590 con 0x7f2f880ac630 2023-11-24T07:57:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.802+0000 7f2f86ffd640 1 -- 172.21.15.5:0/268863012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700aa920 con 0x7f2f880ac630 2023-11-24T07:57:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- 172.21.15.5:0/268863012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f880ac630 msgr2=0x7f2f880706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- 172.21.15.5:0/268863012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f880ac630 0x7f2f880706e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f880ce840 tx=0x7f2f7001c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- 172.21.15.5:0/268863012 shutdown_connections 2023-11-24T07:57:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- 172.21.15.5:0/268863012 >> v2:172.21.15.102:3300/0 conn(0x7f2f88070c20 0x7f2f8806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- 172.21.15.5:0/268863012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f880ac630 0x7f2f880706e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- 172.21.15.5:0/268863012 >> 172.21.15.5:0/268863012 conn(0x7f2f880b0c40 msgr2=0x7f2f880b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- 172.21.15.5:0/268863012 shutdown_connections 2023-11-24T07:57:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- 172.21.15.5:0/268863012 wait complete. 2023-11-24T07:57:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 Processor -- start 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- start start 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f880ac630 0x7f2f88137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f88144c80 0x7f2f88156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880b3790 con 0x7f2f88070c20 2023-11-24T07:57:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88153c50 con 0x7f2f88144c80 2023-11-24T07:57:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f8defe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88138260 con 0x7f2f880ac630 2023-11-24T07:57:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46818/0 (socket says 172.21.15.5:46818) 2023-11-24T07:57:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 -- 172.21.15.5:0/2689795999 learned_addr learned my addr 172.21.15.5:0/2689795999 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f7ffff640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f880ac630 0x7f2f88137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f87fff640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f88144c80 0x7f2f88156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 -- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f880ac630 msgr2=0x7f2f88137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f880ac630 0x7f2f88137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 -- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f88144c80 msgr2=0x7f2f88156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f88144c80 0x7f2f88156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 -- 172.21.15.5:0/2689795999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700094d0 con 0x7f2f88070c20 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.806+0000 7f2f877fe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c3c0 tx=0x7f2f7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780052d0 con 0x7f2f88070c20 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78005430 con 0x7f2f88070c20 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78003840 con 0x7f2f88070c20 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88154c30 con 0x7f2f88070c20 2023-11-24T07:57:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880b31d0 con 0x7f2f88070c20 2023-11-24T07:57:30.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f880b1ba0 con 0x7f2f88070c20 2023-11-24T07:57:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f780039a0 con 0x7f2f88070c20 2023-11-24T07:57:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 0x7f2f68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f78083500 con 0x7f2f88070c20 2023-11-24T07:57:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f7ffff640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 0x7f2f68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.810+0000 7f2f7ffff640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 0x7f2f68068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ae000 tx=0x7f2f700a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:30.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.814+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f78050860 con 0x7f2f88070c20 2023-11-24T07:57:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.970+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f8804e850 con 0x7f2f88070c20 2023-11-24T07:57:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f84ff9640 1 -- 172.21.15.5:0/2689795999 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f2f78053e80 con 0x7f2f88070c20 2023-11-24T07:57:30.977 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:30.977 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:30.155421+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 msgr2=0x7f2f68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 0x7f2f68068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ae000 tx=0x7f2f700a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 msgr2=0x7f2f88153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c3c0 tx=0x7f2f7800c880 comp rx=0 tx=0).stop 2023-11-24T07:57:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 shutdown_connections 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f68066470 0x7f2f68068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f88144c80 0x7f2f88156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f880ac630 0x7f2f88137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 --2- 172.21.15.5:0/2689795999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f88070c20 0x7f2f88153710 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 >> 172.21.15.5:0/2689795999 conn(0x7f2f880b0c40 msgr2=0x7f2f880abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 shutdown_connections 2023-11-24T07:57:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:30.974+0000 7f2f8defe640 1 -- 172.21.15.5:0/2689795999 wait complete. 2023-11-24T07:57:30.999 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T07:57:30.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 Processor -- start 2023-11-24T07:57:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 -- start start 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f300cead0 0x7f6f300d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300d22c0 con 0x7f6f3015d7b0 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300cefd0 con 0x7f6f300d1eb0 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f36d35640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300d17e0 con 0x7f6f300cead0 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f34ad1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f3015d7b0 0x7f6f300d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52034/0 (socket says 172.21.15.5:52034) 2023-11-24T07:57:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f34ad1640 1 -- 172.21.15.5:0/2862951403 learned_addr learned my addr 172.21.15.5:0/2862951403 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.138+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/2862951403 >> v2:172.21.15.102:3300/0 conn(0x7f6f300cead0 0x7f6f300d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059438553 0 0) 0x7f6f300d22c0 con 0x7f6f3015d7b0 2023-11-24T07:57:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f20003530 con 0x7f6f3015d7b0 2023-11-24T07:57:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146896043 0 0) 0x7f6f300cefd0 con 0x7f6f300d1eb0 2023-11-24T07:57:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f300d22c0 con 0x7f6f300d1eb0 2023-11-24T07:57:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1966759701 0 0) 0x7f6f20003530 con 0x7f6f3015d7b0 2023-11-24T07:57:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 >> v2:172.21.15.102:3300/0 conn(0x7f6f300cead0 msgr2=0x7f6f300d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 --2- 172.21.15.5:0/2862951403 >> v2:172.21.15.102:3300/0 conn(0x7f6f300cead0 0x7f6f300d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 >> v1:172.21.15.102:6789/0 conn(0x7f6f300d1eb0 legacy=0x7f6f3006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300cf2b0 con 0x7f6f3015d7b0 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f6f24001680 con 0x7f6f3015d7b0 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 >> v1:172.21.15.5:6789/0 conn(0x7f6f3015d7b0 legacy=0x7f6f300d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f20003b10 0x7f6f20003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300d17e0 con 0x7f6f20005200 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2000c160 con 0x7f6f20003b10 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2000c320 con 0x7f6f200047d0 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f34ad1640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f20003b10 0x7f6f20003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 -- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f200047d0 msgr2=0x7f6f20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f200047d0 0x7f6f20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 -- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f20003b10 msgr2=0x7f6f20003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f20003b10 0x7f6f20003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 -- 172.21.15.5:0/2862951403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20003530 con 0x7f6f20005200 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.142+0000 7f6f352d2640 1 -- 172.21.15.5:0/2862951403 reap_dead start 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f352d2640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f2000b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f28001fd0 tx=0x7f6f2801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb574dda544e88b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28003b80 con 0x7f6f20005200 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28003ce0 con 0x7f6f20005200 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f2f7fe640 1 -- 172.21.15.5:0/2862951403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28005310 con 0x7f6f20005200 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 msgr2=0x7f6f2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f2000b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f28001fd0 tx=0x7f6f2801c8b0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- 172.21.15.5:0/2862951403 shutdown_connections 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 --2- 172.21.15.5:0/2862951403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f2000b990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- 172.21.15.5:0/2862951403 >> 172.21.15.5:0/2862951403 conn(0x7f6f300d33b0 msgr2=0x7f6f300d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- 172.21.15.5:0/2862951403 shutdown_connections 2023-11-24T07:57:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- 172.21.15.5:0/2862951403 wait complete. 2023-11-24T07:57:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 Processor -- start 2023-11-24T07:57:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- start start 2023-11-24T07:57:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 0x7f6f300b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f300cb910 0x7f6f300cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cd3c0 con 0x7f6f20005200 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cd7e0 con 0x7f6f300b88b0 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.146+0000 7f6f36d35640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b9250 con 0x7f6f300cb910 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46840/0 (socket says 172.21.15.5:46840) 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 -- 172.21.15.5:0/7087046 learned_addr learned my addr 172.21.15.5:0/7087046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 -- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f300cb910 msgr2=0x7f6f300cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f300cb910 0x7f6f300cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 0x7f6f300b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 -- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 msgr2=0x7f6f300b8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 0x7f6f300b8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 -- 172.21.15.5:0/7087046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300cc740 con 0x7f6f20005200 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 0x7f6f300b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f34ad1640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f24004f00 tx=0x7f6f24007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24001050 con 0x7f6f20005200 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400f7b0 con 0x7f6f20005200 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400fb40 con 0x7f6f20005200 2023-11-24T07:57:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300cca20 con 0x7f6f20005200 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f300ccfe0 con 0x7f6f20005200 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f300cd500 con 0x7f6f20005200 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.150+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f2400fca0 con 0x7f6f20005200 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.154+0000 7f6f2d7fa640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 0x7f6f14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.154+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6f24083fe0 con 0x7f6f20005200 2023-11-24T07:57:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.154+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 0x7f6f14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.154+0000 7f6f2ffff640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 0x7f6f14068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009490 tx=0x7f6f1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.158+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f300cd500 con 0x7f6f20005200 2023-11-24T07:57:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f300cd500 con 0x7f6f20005200 2023-11-24T07:57:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f2d7fa640 1 -- 172.21.15.5:0/7087046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6f300cd500 con 0x7f6f20005200 2023-11-24T07:57:31.358 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:31.358 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 msgr2=0x7f6f14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 0x7f6f14068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009490 tx=0x7f6f1c008040 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 msgr2=0x7f6f30155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f24004f00 tx=0x7f6f24007430 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 shutdown_connections 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6f14066470 0x7f6f14068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f300cb910 0x7f6f300cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f300b88b0 0x7f6f300b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 --2- 172.21.15.5:0/7087046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f20005200 0x7f6f30155950 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 >> 172.21.15.5:0/7087046 conn(0x7f6f300d33b0 msgr2=0x7f6f300cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 shutdown_connections 2023-11-24T07:57:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.354+0000 7f6f36d35640 1 -- 172.21.15.5:0/7087046 wait complete. 2023-11-24T07:57:31.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 Processor -- start 2023-11-24T07:57:31.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 -- start start 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 0x7f4fd80b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fd806cd40 0x7f4fd8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80b2920 con 0x7f4fd80b1f40 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80b2c00 con 0x7f4fd806cd40 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.518+0000 7f4fdf479640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80b2ee0 con 0x7f4fd815f540 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdca14640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fd80b1f40 0x7f4fd806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52044/0 (socket says 172.21.15.5:52044) 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fd806cd40 0x7f4fd8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdca14640 1 -- 172.21.15.5:0/2942139306 learned_addr learned my addr 172.21.15.5:0/2942139306 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdd215640 1 --2- 172.21.15.5:0/2942139306 >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 0x7f4fd80b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 -- 172.21.15.5:0/2942139306 >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 msgr2=0x7f4fd80b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 --2- 172.21.15.5:0/2942139306 >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 0x7f4fd80b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 -- 172.21.15.5:0/2942139306 >> v1:172.21.15.5:6789/0 conn(0x7f4fd80b1f40 legacy=0x7f4fd806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 -- 172.21.15.5:0/2942139306 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80b31c0 con 0x7f4fd806cd40 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fcffff640 1 -- 172.21.15.5:0/2942139306 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357849292 0 0) 0x7f4fd80b2920 con 0x7f4fd80b1f40 2023-11-24T07:57:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdd215640 1 --2- 172.21.15.5:0/2942139306 >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 0x7f4fd80b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:31.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fdda16640 1 --2- 172.21.15.5:0/2942139306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd8070880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4fd806c230 tx=0x7f4fd001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6b5e32a83fbfbc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fcffff640 1 -- 172.21.15.5:0/2942139306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a59c0 con 0x7f4fd806cd40 2023-11-24T07:57:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fcffff640 1 -- 172.21.15.5:0/2942139306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00a5b20 con 0x7f4fd806cd40 2023-11-24T07:57:31.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.522+0000 7f4fcffff640 1 -- 172.21.15.5:0/2942139306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00ad440 con 0x7f4fd806cd40 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- 172.21.15.5:0/2942139306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 msgr2=0x7f4fd8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- 172.21.15.5:0/2942139306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd8070880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4fd806c230 tx=0x7f4fd001c8e0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- 172.21.15.5:0/2942139306 shutdown_connections 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- 172.21.15.5:0/2942139306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd8070880 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- 172.21.15.5:0/2942139306 >> v2:172.21.15.102:3300/0 conn(0x7f4fd815f540 0x7f4fd80b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- 172.21.15.5:0/2942139306 >> 172.21.15.5:0/2942139306 conn(0x7f4fd80b0c40 msgr2=0x7f4fd80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- 172.21.15.5:0/2942139306 shutdown_connections 2023-11-24T07:57:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- 172.21.15.5:0/2942139306 wait complete. 2023-11-24T07:57:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 Processor -- start 2023-11-24T07:57:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- start start 2023-11-24T07:57:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 0x7f4fd815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fd815f540 0x7f4fd8163f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd814e850 con 0x7f4fd806cd40 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8152f60 con 0x7f4fd80b1f40 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdf479640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8153240 con 0x7f4fd815f540 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46868/0 (socket says 172.21.15.5:46868) 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 -- 172.21.15.5:0/3595589737 learned_addr learned my addr 172.21.15.5:0/3595589737 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdca14640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 0x7f4fd815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdda16640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fd815f540 0x7f4fd8163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 -- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fd815f540 msgr2=0x7f4fd8163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fd815f540 0x7f4fd8163f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 -- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 msgr2=0x7f4fd815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 0x7f4fd815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdd215640 1 -- 172.21.15.5:0/3595589737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009a70 con 0x7f4fd806cd40 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.526+0000 7f4fdca14640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 0x7f4fd815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fdd215640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400d800 tx=0x7f4fd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400b6c0 con 0x7f4fd806cd40 2023-11-24T07:57:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd400b820 con 0x7f4fd806cd40 2023-11-24T07:57:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd815ce70 con 0x7f4fd806cd40 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400bbd0 con 0x7f4fd806cd40 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd815d430 con 0x7f4fd806cd40 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd804e850 con 0x7f4fd806cd40 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fd400bd30 con 0x7f4fd806cd40 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 0x7f4fbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4fd40844a0 con 0x7f4fd806cd40 2023-11-24T07:57:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.530+0000 7f4fdca14640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 0x7f4fbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.534+0000 7f4fdca14640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 0x7f4fbc068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8007fd0 tx=0x7f4fc8007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.534+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fd4051800 con 0x7f4fd806cd40 2023-11-24T07:57:31.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.730+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fd80ced70 con 0x7f4fd806cd40 2023-11-24T07:57:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fcdffb640 1 -- 172.21.15.5:0/3595589737 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4fd4054e20 con 0x7f4fd806cd40 2023-11-24T07:57:31.737 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:31.737 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/1717778713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1717778713},{"type":"v1","addr":"172.21.15.102:6836","nonce":1717778713}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2241520031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2241520031},{"type":"v1","addr":"172.21.15.5:6833","nonce":2241520031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1742013688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1742013688},{"type":"v1","addr":"172.21.15.5:6835","nonce":1742013688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:56:49.369605+0000","modified":"2023-11-24T07:56:52.375988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3914236493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3914236493},{"type":"v1","addr":"172.21.15.102:6837","nonce":3914236493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T07:57:31.737 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-11-24T07:57:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 msgr2=0x7f4fbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 0x7f4fbc068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8007fd0 tx=0x7f4fc8007c20 comp rx=0 tx=0).stop 2023-11-24T07:57:31.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 msgr2=0x7f4fd814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400d800 tx=0x7f4fd400dcc0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 shutdown_connections 2023-11-24T07:57:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4fbc066470 0x7f4fbc068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fd815f540 0x7f4fd8163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fd80b1f40 0x7f4fd815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 --2- 172.21.15.5:0/3595589737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd806cd40 0x7f4fd814e310 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 >> 172.21.15.5:0/3595589737 conn(0x7f4fd80b0c40 msgr2=0x7f4fd80b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 shutdown_connections 2023-11-24T07:57:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.734+0000 7f4fdf479640 1 -- 172.21.15.5:0/3595589737 wait complete. 2023-11-24T07:57:31.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 Processor -- start 2023-11-24T07:57:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 -- start start 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 0x7fcc380cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcc380b2850 0x7fcc380b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3806d4f0 con 0x7fcc38160980 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc380d2070 con 0x7fcc380b2850 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e9f8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3806c150 con 0x7fcc3806bc90 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d9f6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc38160980 0x7fcc3806b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52054/0 (socket says 172.21.15.5:52054) 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d9f6640 1 -- 172.21.15.5:0/5661419 learned_addr learned my addr 172.21.15.5:0/5661419 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/5661419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 0x7fcc380cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3e1f7640 1 --2- 172.21.15.5:0/5661419 >> v2:172.21.15.102:3300/0 conn(0x7fcc380b2850 0x7fcc380b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503107309 0 0) 0x7fcc3806d4f0 con 0x7fcc38160980 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc24003530 con 0x7fcc38160980 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d1f5640 1 -- 172.21.15.5:0/5661419 >> v2:172.21.15.102:3300/0 conn(0x7fcc380b2850 msgr2=0x7fcc380b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/5661419 >> v2:172.21.15.102:3300/0 conn(0x7fcc380b2850 0x7fcc380b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d1f5640 1 -- 172.21.15.5:0/5661419 >> v1:172.21.15.5:6789/0 conn(0x7fcc38160980 legacy=0x7fcc3806b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1145412310 0 0) 0x7fcc24003530 con 0x7fcc38160980 2023-11-24T07:57:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.898+0000 7fcc3d1f5640 1 -- 172.21.15.5:0/5661419 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3806c430 con 0x7fcc3806bc90 2023-11-24T07:57:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/5661419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 0x7fcc380cdc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097c0 tx=0x7fcc2801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e37765c3da7116 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34001680 con 0x7fcc3806bc90 2023-11-24T07:57:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc280a7050 con 0x7fcc3806bc90 2023-11-24T07:57:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3c9f4640 1 -- 172.21.15.5:0/5661419 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280ab600 con 0x7fcc3806bc90 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/5661419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 msgr2=0x7fcc380cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/5661419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 0x7fcc380cdc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097c0 tx=0x7fcc2801c370 comp rx=0 tx=0).stop 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/5661419 shutdown_connections 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/5661419 >> v2:172.21.15.102:3300/0 conn(0x7fcc380b2850 0x7fcc380b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/5661419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc3806bc90 0x7fcc380cdc00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/5661419 >> 172.21.15.5:0/5661419 conn(0x7fcc3809c5c0 msgr2=0x7fcc380d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/5661419 shutdown_connections 2023-11-24T07:57:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.902+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/5661419 wait complete. 2023-11-24T07:57:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 Processor -- start 2023-11-24T07:57:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- start start 2023-11-24T07:57:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc380b2850 0x7fcc380b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc38160980 0x7fcc38157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380c9320 con 0x7fcc3806bc90 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380c8430 con 0x7fcc380b2850 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380c8710 con 0x7fcc38160980 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46882/0 (socket says 172.21.15.5:46882) 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 -- 172.21.15.5:0/3279482803 learned_addr learned my addr 172.21.15.5:0/3279482803 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc380b2850 0x7fcc380b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e1f7640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc38160980 0x7fcc38157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 -- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc38160980 msgr2=0x7fcc38157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc38160980 0x7fcc38157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 -- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc380b2850 msgr2=0x7fcc380b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc380b2850 0x7fcc380b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 -- 172.21.15.5:0/3279482803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28009420 con 0x7fcc3806bc90 2023-11-24T07:57:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3d9f6640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c750 tx=0x7fcc3400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34005ae0 con 0x7fcc3806bc90 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34005c40 con 0x7fcc3806bc90 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34007070 con 0x7fcc3806bc90 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc380c89f0 con 0x7fcc3806bc90 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc380c8fb0 con 0x7fcc3806bc90 2023-11-24T07:57:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.906+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc380c94d0 con 0x7fcc3806bc90 2023-11-24T07:57:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.910+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc340071f0 con 0x7fcc3806bc90 2023-11-24T07:57:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.910+0000 7fcc2e7fc640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 0x7fcc1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.910+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcc340834e0 con 0x7fcc3806bc90 2023-11-24T07:57:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.910+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 0x7fcc1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.910+0000 7fcc3d1f5640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 0x7fcc1c068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc280ad000 tx=0x7fcc280a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:31.914+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc34050980 con 0x7fcc3806bc90 2023-11-24T07:57:32.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.074+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc38074a00 con 0x7fcc3806bc90 2023-11-24T07:57:32.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.074+0000 7fcc2e7fc640 1 -- 172.21.15.5:0/3279482803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fcc34053fa0 con 0x7fcc3806bc90 2023-11-24T07:57:32.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:32.079 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:31.167434+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:56:47.343209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T07:56:48.359794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 msgr2=0x7fcc1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 0x7fcc1c068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc280ad000 tx=0x7fcc280a6000 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 msgr2=0x7fcc3815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c750 tx=0x7fcc3400cc10 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 shutdown_connections 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcc1c066470 0x7fcc1c068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc38160980 0x7fcc38157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc380b2850 0x7fcc380b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 --2- 172.21.15.5:0/3279482803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc3806bc90 0x7fcc3815cfe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 >> 172.21.15.5:0/3279482803 conn(0x7fcc3809c5c0 msgr2=0x7fcc380d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:32.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 shutdown_connections 2023-11-24T07:57:32.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.078+0000 7fcc3e9f8640 1 -- 172.21.15.5:0/3279482803 wait complete. 2023-11-24T07:57:32.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T07:57:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 Processor -- start 2023-11-24T07:57:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 -- start start 2023-11-24T07:57:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 0x7f780c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f780c0cbd90 0x7f780c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 0x7f780c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c15bba0 con 0x7f780c0cbd90 2023-11-24T07:57:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0cdd50 con 0x7f780c0cb9b0 2023-11-24T07:57:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7814501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c159630 con 0x7f780c0ce5d0 2023-11-24T07:57:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f780c0cbd90 0x7f780c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f780c0cbd90 0x7f780c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46888/0 (socket says 172.21.15.5:46888) 2023-11-24T07:57:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 -- 172.21.15.5:0/1002966197 learned_addr learned my addr 172.21.15.5:0/1002966197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7812a9e640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 0x7f780c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f781229d640 1 --2- 172.21.15.5:0/1002966197 >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 0x7f780c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 -- 172.21.15.5:0/1002966197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 msgr2=0x7f780c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 0x7f780c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 -- 172.21.15.5:0/1002966197 >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 msgr2=0x7f780c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 --2- 172.21.15.5:0/1002966197 >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 0x7f780c06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7811a9c640 1 -- 172.21.15.5:0/1002966197 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c15f6d0 con 0x7f780c0cbd90 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f781229d640 1 --2- 172.21.15.5:0/1002966197 >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 0x7f780c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.242+0000 7f7812a9e640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 0x7f780c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7811a9c640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0cbd90 0x7f780c15f190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780c06c360 tx=0x7f77fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb1e49d516c7608 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f781129b640 1 -- 172.21.15.5:0/1002966197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab670 con 0x7f780c0cbd90 2023-11-24T07:57:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f781129b640 1 -- 172.21.15.5:0/1002966197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0ab7d0 con 0x7f780c0cbd90 2023-11-24T07:57:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f781129b640 1 -- 172.21.15.5:0/1002966197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0abb60 con 0x7f780c0cbd90 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 -- 172.21.15.5:0/1002966197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0cbd90 msgr2=0x7f780c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0cbd90 0x7f780c15f190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780c06c360 tx=0x7f77fc01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 -- 172.21.15.5:0/1002966197 shutdown_connections 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0ce5d0 0x7f780c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 --2- 172.21.15.5:0/1002966197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0cbd90 0x7f780c15f190 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 --2- 172.21.15.5:0/1002966197 >> v2:172.21.15.102:3300/0 conn(0x7f780c0cb9b0 0x7f780c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 -- 172.21.15.5:0/1002966197 >> 172.21.15.5:0/1002966197 conn(0x7f780c0b0cb0 msgr2=0x7f780c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 -- 172.21.15.5:0/1002966197 shutdown_connections 2023-11-24T07:57:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.246+0000 7f7814501640 1 -- 172.21.15.5:0/1002966197 wait complete. 2023-11-24T07:57:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 Processor -- start 2023-11-24T07:57:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- start start 2023-11-24T07:57:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f780c0cb9b0 0x7f780c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0cbd90 0x7f780c09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0b20b0 con 0x7f780c0ce5d0 2023-11-24T07:57:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0ad760 con 0x7f780c0cb9b0 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0ada40 con 0x7f780c0cbd90 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46902/0 (socket says 172.21.15.5:46902) 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 -- 172.21.15.5:0/3986669519 learned_addr learned my addr 172.21.15.5:0/3986669519 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7811a9c640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0cbd90 0x7f780c09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f781229d640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f780c0cb9b0 0x7f780c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 -- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0cbd90 msgr2=0x7f780c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0cbd90 0x7f780c09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 -- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f780c0cb9b0 msgr2=0x7f780c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f780c0cb9b0 0x7f780c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 -- 172.21.15.5:0/3986669519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0094d0 con 0x7f780c0ce5d0 2023-11-24T07:57:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7812a9e640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f780400cd50 tx=0x7f780400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400f680 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400f800 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400fbb0 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0add20 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.250+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c158fc0 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c0671f0 con 0x7f780c0ce5d0 2023-11-24T07:57:32.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f780400b040 con 0x7f780c0ce5d0 2023-11-24T07:57:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f7802ffd640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 0x7f77f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7804084770 con 0x7f780c0ce5d0 2023-11-24T07:57:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f781229d640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 0x7f77f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.254+0000 7f781229d640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 0x7f77f0068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f780c0ac990 tx=0x7f7808008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.258+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7804051c10 con 0x7f780c0ce5d0 2023-11-24T07:57:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.446+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f780c06b460 con 0x7f780c0ce5d0 2023-11-24T07:57:32.451 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-11-24T07:57:32.446+0000 7f60226ed640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T07:57:32.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7802ffd640 1 -- 172.21.15.5:0/3986669519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7804055230 con 0x7f780c0ce5d0 2023-11-24T07:57:32.454 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T07:57:32.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 msgr2=0x7f77f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 0x7f77f0068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f780c0ac990 tx=0x7f7808008040 comp rx=0 tx=0).stop 2023-11-24T07:57:32.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 msgr2=0x7f780c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f780400cd50 tx=0x7f780400a650 comp rx=0 tx=0).stop 2023-11-24T07:57:32.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 shutdown_connections 2023-11-24T07:57:32.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f77f0066470 0x7f77f0068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f780c0ce5d0 0x7f780c09aa30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f780c0cbd90 0x7f780c09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 --2- 172.21.15.5:0/3986669519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f780c0cb9b0 0x7f780c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 >> 172.21.15.5:0/3986669519 conn(0x7f780c0b0cb0 msgr2=0x7f780c15fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:32.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 shutdown_connections 2023-11-24T07:57:32.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.450+0000 7f7814501640 1 -- 172.21.15.5:0/3986669519 wait complete. 2023-11-24T07:57:32.470 INFO:tasks.ceph.mds.b.smithi102.stderr: -6757> 2023-11-24T07:56:53.613+0000 7f9a2d94a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T07:57:32.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T07:57:32.522 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2023-11-24T07:57:32.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 Processor -- start 2023-11-24T07:57:32.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 -- start start 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe87415a710 0x7fe8740abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740b2710 con 0x7fe8740cdfb0 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740cca80 con 0x7fe87415a710 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8797f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b29f0 con 0x7fe8740cbd50 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:43408/0 (socket says 172.21.15.5:43408) 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 -- 172.21.15.5:0/1991597476 learned_addr learned my addr 172.21.15.5:0/1991597476 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe872ffd640 1 --1- 172.21.15.5:0/1991597476 >> v1:172.21.15.102:6789/0 conn(0x7fe8740cdfb0 0x7fe8740ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:35806/0 (socket says 172.21.15.5:35806) 2023-11-24T07:57:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe86bfff640 1 --2- 172.21.15.5:0/1991597476 >> v2:172.21.15.102:3300/0 conn(0x7fe87415a710 0x7fe8740abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 -- 172.21.15.5:0/1991597476 >> v2:172.21.15.102:3300/0 conn(0x7fe87415a710 msgr2=0x7fe8740abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 --2- 172.21.15.5:0/1991597476 >> v2:172.21.15.102:3300/0 conn(0x7fe87415a710 0x7fe8740abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 -- 172.21.15.5:0/1991597476 >> v1:172.21.15.102:6789/0 conn(0x7fe8740cdfb0 legacy=0x7fe8740ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.618+0000 7fe8737fe640 1 -- 172.21.15.5:0/1991597476 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740b2cd0 con 0x7fe8740cbd50 2023-11-24T07:57:32.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8737fe640 1 --2- 172.21.15.5:0/1991597476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009e50 tx=0x7fe86c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c135fdfafa95f095 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8727fc640 1 -- 172.21.15.5:0/1991597476 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0a58d0 con 0x7fe8740cbd50 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8727fc640 1 -- 172.21.15.5:0/1991597476 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c0a5a30 con 0x7fe8740cbd50 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8727fc640 1 -- 172.21.15.5:0/1991597476 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0a5dc0 con 0x7fe8740cbd50 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 -- 172.21.15.5:0/1991597476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 msgr2=0x7fe8740cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 --2- 172.21.15.5:0/1991597476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009e50 tx=0x7fe86c01c9e0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 -- 172.21.15.5:0/1991597476 shutdown_connections 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 --2- 172.21.15.5:0/1991597476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8740cc1e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 --2- 172.21.15.5:0/1991597476 >> v2:172.21.15.102:3300/0 conn(0x7fe87415a710 0x7fe8740abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 -- 172.21.15.5:0/1991597476 >> 172.21.15.5:0/1991597476 conn(0x7fe8740b0cb0 msgr2=0x7fe8740b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:32.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 -- 172.21.15.5:0/1991597476 shutdown_connections 2023-11-24T07:57:32.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 -- 172.21.15.5:0/1991597476 wait complete. 2023-11-24T07:57:32.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.622+0000 7fe8797f5640 1 Processor -- start 2023-11-24T07:57:32.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- start start 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8741526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8740cdfb0 0x7fe8741542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874152c20 con 0x7fe87415a710 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874153140 con 0x7fe8740cdfb0 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740716f0 con 0x7fe8740cbd50 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe872ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8741526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46912/0 (socket says 172.21.15.5:46912) 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 -- 172.21.15.5:0/4203313649 learned_addr learned my addr 172.21.15.5:0/4203313649 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe86bfff640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8740cdfb0 0x7fe8741542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 -- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 msgr2=0x7fe8741526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8741526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 -- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8740cdfb0 msgr2=0x7fe8741542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8740cdfb0 0x7fe8741542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:32.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 -- 172.21.15.5:0/4203313649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c009b30 con 0x7fe87415a710 2023-11-24T07:57:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8737fe640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe86c01a610 tx=0x7fe86c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0b8670 con 0x7fe87415a710 2023-11-24T07:57:32.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c0b87f0 con 0x7fe87415a710 2023-11-24T07:57:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8740719d0 con 0x7fe87415a710 2023-11-24T07:57:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0b8ba0 con 0x7fe87415a710 2023-11-24T07:57:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe874071f90 con 0x7fe87415a710 2023-11-24T07:57:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.626+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8740671f0 con 0x7fe87415a710 2023-11-24T07:57:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.630+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe86c0b8d00 con 0x7fe87415a710 2023-11-24T07:57:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.630+0000 7fe86b7fe640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 0x7fe854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.630+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe86c11f400 con 0x7fe87415a710 2023-11-24T07:57:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.630+0000 7fe872ffd640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 0x7fe854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.630+0000 7fe872ffd640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 0x7fe854068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe864000f70 tx=0x7fe864007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:32.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.634+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe86c0ec9a0 con 0x7fe87415a710 2023-11-24T07:57:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:32.822+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe87406b460 con 0x7fe87415a710 2023-11-24T07:57:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.450+0000 7fe86b7fe640 1 -- 172.21.15.5:0/4203313649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe86c0effc0 con 0x7fe87415a710 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 msgr2=0x7fe854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 0x7fe854068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe864000f70 tx=0x7fe864007e50 comp rx=0 tx=0).stop 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 msgr2=0x7fe874154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe86c01a610 tx=0x7fe86c019780 comp rx=0 tx=0).stop 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 shutdown_connections 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fe854066470 0x7fe854068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87415a710 0x7fe874154830 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8740cdfb0 0x7fe8741542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 --2- 172.21.15.5:0/4203313649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8740cbd50 0x7fe8741526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 >> 172.21.15.5:0/4203313649 conn(0x7fe8740b0cb0 msgr2=0x7fe8740b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 shutdown_connections 2023-11-24T07:57:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.454+0000 7fe8797f5640 1 -- 172.21.15.5:0/4203313649 wait complete. 2023-11-24T07:57:33.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T07:57:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 Processor -- start 2023-11-24T07:57:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 -- start start 2023-11-24T07:57:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9de415d7c0 0x7f9de40d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40d11a0 con 0x7f9de4161f20 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40d1480 con 0x7f9de40d04c0 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de9479640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40d0f90 con 0x7f9de415d7c0 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9ddbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9de4161f20 0x7f9de40cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52070/0 (socket says 172.21.15.5:52070) 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9ddbfff640 1 -- 172.21.15.5:0/3392335460 learned_addr learned my addr 172.21.15.5:0/3392335460 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de2ffd640 1 --2- 172.21.15.5:0/3392335460 >> v2:172.21.15.102:3300/0 conn(0x7f9de415d7c0 0x7f9de40d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327127182 0 0) 0x7f9de40d11a0 con 0x7f9de4161f20 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd0003530 con 0x7f9de4161f20 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249393237 0 0) 0x7f9de40d1480 con 0x7f9de40d04c0 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de40d11a0 con 0x7f9de40d04c0 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de2ffd640 1 -- 172.21.15.5:0/3392335460 >> v1:172.21.15.102:6789/0 conn(0x7f9de40d04c0 legacy=0x7f9de40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de2ffd640 1 -- 172.21.15.5:0/3392335460 >> v1:172.21.15.5:6789/0 conn(0x7f9de4161f20 legacy=0x7f9de40cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.630+0000 7f9de2ffd640 1 -- 172.21.15.5:0/3392335460 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40d1760 con 0x7f9de415d7c0 2023-11-24T07:57:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de2ffd640 1 --2- 172.21.15.5:0/3392335460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de415d7c0 0x7f9de40d3d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40097f0 tx=0x7f9dd401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e348494cb06b10e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40ac620 con 0x7f9de415d7c0 2023-11-24T07:57:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40ac780 con 0x7f9de415d7c0 2023-11-24T07:57:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de27fc640 1 -- 172.21.15.5:0/3392335460 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40acb10 con 0x7f9de415d7c0 2023-11-24T07:57:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 -- 172.21.15.5:0/3392335460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de415d7c0 msgr2=0x7f9de40d3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 --2- 172.21.15.5:0/3392335460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de415d7c0 0x7f9de40d3d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40097f0 tx=0x7f9dd401c3c0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 -- 172.21.15.5:0/3392335460 shutdown_connections 2023-11-24T07:57:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 --2- 172.21.15.5:0/3392335460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de415d7c0 0x7f9de40d3d50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 -- 172.21.15.5:0/3392335460 >> 172.21.15.5:0/3392335460 conn(0x7f9de408afc0 msgr2=0x7f9de40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 -- 172.21.15.5:0/3392335460 shutdown_connections 2023-11-24T07:57:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.634+0000 7f9de9479640 1 -- 172.21.15.5:0/3392335460 wait complete. 2023-11-24T07:57:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 Processor -- start 2023-11-24T07:57:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- start start 2023-11-24T07:57:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de40d04c0 0x7f9de4151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 0x7f9de4154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de41538c0 con 0x7f9de415d7c0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4153ba0 con 0x7f9de41533c0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4153e80 con 0x7f9de40d04c0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46922/0 (socket says 172.21.15.5:46922) 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 -- 172.21.15.5:0/648565429 learned_addr learned my addr 172.21.15.5:0/648565429 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de37fe640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 0x7f9de4154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de2ffd640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de40d04c0 0x7f9de4151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 -- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de40d04c0 msgr2=0x7f9de4151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de40d04c0 0x7f9de4151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 -- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 msgr2=0x7f9de4154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 0x7f9de4154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 -- 172.21.15.5:0/648565429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4009420 con 0x7f9de415d7c0 2023-11-24T07:57:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de37fe640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 0x7f9de4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:33.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddbfff640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0010f0 tx=0x7f9dcc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0074e0 con 0x7f9de415d7c0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc007640 con 0x7f9de415d7c0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0059b0 con 0x7f9de415d7c0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de4154160 con 0x7f9de415d7c0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.638+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de4152a20 con 0x7f9de415d7c0 2023-11-24T07:57:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de404e850 con 0x7f9de415d7c0 2023-11-24T07:57:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dcc005bd0 con 0x7f9de415d7c0 2023-11-24T07:57:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9ddb7fe640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 0x7f9dc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f9dcc083420 con 0x7f9de415d7c0 2023-11-24T07:57:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9de2ffd640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 0x7f9dc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:33.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.642+0000 7f9de2ffd640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 0x7f9dc4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40ae000 tx=0x7f9dd40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.646+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dcc050860 con 0x7f9de415d7c0 2023-11-24T07:57:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:33.806+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9de40b90a0 con 0x7f9de415d7c0 2023-11-24T07:57:34.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.454+0000 7f9ddb7fe640 1 -- 172.21.15.5:0/648565429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9dcc053e80 con 0x7f9de415d7c0 2023-11-24T07:57:34.459 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-11-24T07:57:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 msgr2=0x7f9dc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 0x7f9dc4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40ae000 tx=0x7f9dd40a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 msgr2=0x7f9de40b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0010f0 tx=0x7f9dcc00c890 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 shutdown_connections 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9dc4066470 0x7f9dc4068930 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40ae000 tx=0x7f9dd40a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9de41533c0 0x7f9de4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9de415d7c0 0x7f9de40b5fe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 --2- 172.21.15.5:0/648565429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9de40d04c0 0x7f9de4151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 >> 172.21.15.5:0/648565429 conn(0x7f9de408afc0 msgr2=0x7f9de41592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 shutdown_connections 2023-11-24T07:57:34.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.458+0000 7f9de9479640 1 -- 172.21.15.5:0/648565429 wait complete. 2023-11-24T07:57:34.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T07:57:34.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.634+0000 7fa5c972a640 1 Processor -- start 2023-11-24T07:57:34.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.634+0000 7fa5c972a640 1 -- start start 2023-11-24T07:57:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c972a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c972a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa5c40cbd90 0x7fa5c415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c972a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c4159630 con 0x7fa5c40ce5d0 2023-11-24T07:57:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c972a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c415bba0 con 0x7fa5c40cbd90 2023-11-24T07:57:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c972a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40cdd50 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:43436/0 (socket says 172.21.15.5:43436) 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1474840391 learned_addr learned my addr 172.21.15.5:0/1474840391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5bbfff640 1 --2- 172.21.15.5:0/1474840391 >> v2:172.21.15.102:3300/0 conn(0x7fa5c40cbd90 0x7fa5c415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1474840391 >> v2:172.21.15.102:3300/0 conn(0x7fa5c40cbd90 msgr2=0x7fa5c415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 --2- 172.21.15.5:0/1474840391 >> v2:172.21.15.102:3300/0 conn(0x7fa5c40cbd90 0x7fa5c415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1474840391 >> v1:172.21.15.102:6789/0 conn(0x7fa5c40ce5d0 legacy=0x7fa5c415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.638+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1474840391 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c415f6d0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c2ffd640 1 --2- 172.21.15.5:0/1474840391 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0211e99dc4ab78 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c27fc640 1 -- 172.21.15.5:0/1474840391 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40aa670 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c27fc640 1 -- 172.21.15.5:0/1474840391 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b40aa7d0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c27fc640 1 -- 172.21.15.5:0/1474840391 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40aab60 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- 172.21.15.5:0/1474840391 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 msgr2=0x7fa5c406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1474840391 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009870 tx=0x7fa5b401c510 comp rx=0 tx=0).stop 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- 172.21.15.5:0/1474840391 shutdown_connections 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1474840391 >> v2:172.21.15.102:3300/0 conn(0x7fa5c40cbd90 0x7fa5c415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1474840391 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cb9b0 0x7fa5c406e3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- 172.21.15.5:0/1474840391 >> 172.21.15.5:0/1474840391 conn(0x7fa5c40b0cb0 msgr2=0x7fa5c40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:34.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- 172.21.15.5:0/1474840391 shutdown_connections 2023-11-24T07:57:34.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- 172.21.15.5:0/1474840391 wait complete. 2023-11-24T07:57:34.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 Processor -- start 2023-11-24T07:57:34.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.642+0000 7fa5c972a640 1 -- start start 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 0x7fa5c40acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c40ce5d0 0x7fa5c4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40ac130 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40ac410 con 0x7fa5c40ce5d0 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40ac6f0 con 0x7fa5c40cbd90 2023-11-24T07:57:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46936/0 (socket says 172.21.15.5:46936) 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1204712177 learned_addr learned my addr 172.21.15.5:0/1204712177 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5bbfff640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 0x7fa5c40acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c37fe640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c40ce5d0 0x7fa5c4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 msgr2=0x7fa5c40acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 0x7fa5c40acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c40ce5d0 msgr2=0x7fa5c4150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c40ce5d0 0x7fa5c4150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 -- 172.21.15.5:0/1204712177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40094d0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5bbfff640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 0x7fa5c40acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c2ffd640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ac040 tx=0x7fa5b401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b3800 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b40b3960 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40ac9d0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b3d10 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c40ad430 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.646+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c40671f0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.650+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5b40b2380 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.650+0000 7fa5bb7fe640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 0x7fa5a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.650+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fa5b411df00 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.650+0000 7fa5bbfff640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 0x7fa5a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.650+0000 7fa5bbfff640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 0x7fa5a4068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5c41664f0 tx=0x7fa5ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.654+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5b40eb3c0 con 0x7fa5c40cb9b0 2023-11-24T07:57:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:34.810+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5c40ac270 con 0x7fa5c40cb9b0 2023-11-24T07:57:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.462+0000 7fa5bb7fe640 1 -- 172.21.15.5:0/1204712177 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5c40ac270 con 0x7fa5c40cb9b0 2023-11-24T07:57:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 msgr2=0x7fa5a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 0x7fa5a4068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5c41664f0 tx=0x7fa5ac008040 comp rx=0 tx=0).stop 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 msgr2=0x7fa5c414eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ac040 tx=0x7fa5b401ad50 comp rx=0 tx=0).stop 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 shutdown_connections 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa5a4066470 0x7fa5a4068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c40ce5d0 0x7fa5c4150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c40cbd90 0x7fa5c40acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 --2- 172.21.15.5:0/1204712177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5c40cb9b0 0x7fa5c414eec0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 >> 172.21.15.5:0/1204712177 conn(0x7fa5c40b0cb0 msgr2=0x7fa5c415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 shutdown_connections 2023-11-24T07:57:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.466+0000 7fa5c972a640 1 -- 172.21.15.5:0/1204712177 wait complete. 2023-11-24T07:57:35.496 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T07:57:35.496 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T07:57:35.496 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T07:57:35.496 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:57:35.497 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T07:57:35.497 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T07:57:35.497 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T07:57:35.497 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:57:35.497 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T07:57:35.497 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T07:57:35.498 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T07:57:35.498 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:57:35.498 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T07:57:35.498 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T07:57:35.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T07:57:35.498 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:57:35.512 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T07:57:35.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T07:57:35.515 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T07:57:35.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T07:57:35.516 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T07:57:35.517 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T07:57:35.518 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T07:57:35.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T07:57:35.562 INFO:tasks.ceph.mds.a:Started 2023-11-24T07:57:35.563 DEBUG:teuthology.parallel:result is None 2023-11-24T07:57:35.566 INFO:tasks.ceph.mds.c:Started 2023-11-24T07:57:35.566 DEBUG:teuthology.parallel:result is None 2023-11-24T07:57:35.571 INFO:tasks.ceph.mds.d:Started 2023-11-24T07:57:35.571 DEBUG:teuthology.parallel:result is None 2023-11-24T07:57:35.579 INFO:tasks.ceph.mds.b:Started 2023-11-24T07:57:35.579 DEBUG:teuthology.parallel:result is None 2023-11-24T07:57:35.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T07:57:35.671 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2023-11-24T07:57:35.678 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2023-11-24T07:57:35.705 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-11-24T07:57:35.708 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-11-24T07:57:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 Processor -- start 2023-11-24T07:57:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 -- start start 2023-11-24T07:57:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f73980ae680 0x7f73980cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7398072950 con 0x7f7398070890 2023-11-24T07:57:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739806e2b0 con 0x7f7398159f00 2023-11-24T07:57:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739e6aa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739806c6f0 con 0x7f73980ae680 2023-11-24T07:57:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f73977fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f73980ae680 0x7f73980cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739cc47640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7398070890 0x7f7398070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52104/0 (socket says 172.21.15.5:52104) 2023-11-24T07:57:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f739cc47640 1 -- 172.21.15.5:0/3308525456 learned_addr learned my addr 172.21.15.5:0/3308525456 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f7396ffd640 1 -- 172.21.15.5:0/3308525456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633672497 0 0) 0x7f7398072950 con 0x7f7398070890 2023-11-24T07:57:35.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f73977fe640 1 -- 172.21.15.5:0/3308525456 >> v1:172.21.15.102:6789/0 conn(0x7f7398159f00 legacy=0x7f73980ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f73977fe640 1 -- 172.21.15.5:0/3308525456 >> v1:172.21.15.5:6789/0 conn(0x7f7398070890 legacy=0x7f7398070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.778+0000 7f73977fe640 1 -- 172.21.15.5:0/3308525456 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739806e550 con 0x7f73980ae680 2023-11-24T07:57:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f73977fe640 1 --2- 172.21.15.5:0/3308525456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73980ae680 0x7f73980cd5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f738c00a8e0 tx=0x7f738c01d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b5aa673cbb2e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f7396ffd640 1 -- 172.21.15.5:0/3308525456 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0a7690 con 0x7f73980ae680 2023-11-24T07:57:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f7396ffd640 1 -- 172.21.15.5:0/3308525456 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c0a77f0 con 0x7f73980ae680 2023-11-24T07:57:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f7396ffd640 1 -- 172.21.15.5:0/3308525456 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0a7b80 con 0x7f73980ae680 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 -- 172.21.15.5:0/3308525456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73980ae680 msgr2=0x7f73980cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 --2- 172.21.15.5:0/3308525456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73980ae680 0x7f73980cd5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f738c00a8e0 tx=0x7f738c01d650 comp rx=0 tx=0).stop 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 -- 172.21.15.5:0/3308525456 shutdown_connections 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 --2- 172.21.15.5:0/3308525456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73980ae680 0x7f73980cd5b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 -- 172.21.15.5:0/3308525456 >> 172.21.15.5:0/3308525456 conn(0x7f73980b0cb0 msgr2=0x7f73980b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 -- 172.21.15.5:0/3308525456 shutdown_connections 2023-11-24T07:57:35.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 -- 172.21.15.5:0/3308525456 wait complete. 2023-11-24T07:57:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.782+0000 7f739e6aa640 1 Processor -- start 2023-11-24T07:57:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- start start 2023-11-24T07:57:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7398070890 0x7f739815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7398153c10 0x7f739815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981540c0 con 0x7f73980ae680 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981f3e30 con 0x7f7398153c10 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73981f40a0 con 0x7f7398070890 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46986/0 (socket says 172.21.15.5:46986) 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 -- 172.21.15.5:0/2322855925 learned_addr learned my addr 172.21.15.5:0/2322855925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f7397fff640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7398070890 0x7f739815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739cc47640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7398153c10 0x7f739815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 -- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7398070890 msgr2=0x7f739815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7398070890 0x7f739815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 -- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7398153c10 msgr2=0x7f739815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7398153c10 0x7f739815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 -- 172.21.15.5:0/2322855925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c00a5c0 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f73977fe640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f738c01a260 tx=0x7f738c01a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0b6070 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c0a8680 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0a8a10 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73981f4380 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739815ae50 con 0x7f73980ae680 2023-11-24T07:57:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.786+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73980671f0 con 0x7f73980ae680 2023-11-24T07:57:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.790+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f738c0b1400 con 0x7f73980ae680 2023-11-24T07:57:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.790+0000 7f7394ff9640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 0x7f7384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.790+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f738c11d800 con 0x7f73980ae680 2023-11-24T07:57:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.790+0000 7f7397fff640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 0x7f7384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.790+0000 7f7397fff640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 0x7f7384068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:35.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.794+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f738c0eb020 con 0x7f73980ae680 2023-11-24T07:57:35.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:35.962+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f739806b460 con 0x7f73980ae680 2023-11-24T07:57:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.218+0000 7f7394ff9640 1 -- 172.21.15.5:0/2322855925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f738c0ee640 con 0x7f73980ae680 2023-11-24T07:57:37.218 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-11-24T07:57:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 msgr2=0x7f7384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 0x7f7384068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 msgr2=0x7f73981536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f738c01a260 tx=0x7f738c01a3f0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 shutdown_connections 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7384066470 0x7f7384068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7398153c10 0x7f739815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73980ae680 0x7f73981536d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 --2- 172.21.15.5:0/2322855925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7398070890 0x7f739815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 >> 172.21.15.5:0/2322855925 conn(0x7f73980b0cb0 msgr2=0x7f73980b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 shutdown_connections 2023-11-24T07:57:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.222+0000 7f739e6aa640 1 -- 172.21.15.5:0/2322855925 wait complete. 2023-11-24T07:57:37.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T07:57:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 Processor -- start 2023-11-24T07:57:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 -- start start 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d9415d510 0x7f8d940b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d940b3cc0 0x7f8d9406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9406cf50 con 0x7f8d9406d920 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9415d8f0 con 0x7f8d940b3cc0 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d9a4d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9406cc20 con 0x7f8d9415d510 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d940b3cc0 0x7f8d9406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d940b3cc0 0x7f8d9406d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56934/0 (socket says 172.21.15.5:56934) 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.390+0000 7f8d937fe640 1 -- 172.21.15.5:0/3791399544 learned_addr learned my addr 172.21.15.5:0/3791399544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d93fff640 1 --2- 172.21.15.5:0/3791399544 >> v2:172.21.15.102:3300/0 conn(0x7f8d9415d510 0x7f8d940b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d937fe640 1 -- 172.21.15.5:0/3791399544 >> v2:172.21.15.102:3300/0 conn(0x7f8d9415d510 msgr2=0x7f8d940b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d937fe640 1 --2- 172.21.15.5:0/3791399544 >> v2:172.21.15.102:3300/0 conn(0x7f8d9415d510 0x7f8d940b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d937fe640 1 -- 172.21.15.5:0/3791399544 >> v1:172.21.15.102:6789/0 conn(0x7f8d9406d920 legacy=0x7f8d940715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:37.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d937fe640 1 -- 172.21.15.5:0/3791399544 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940b31d0 con 0x7f8d940b3cc0 2023-11-24T07:57:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d937fe640 1 --2- 172.21.15.5:0/3791399544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d940b3cc0 0x7f8d9406d3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d9406b8f0 tx=0x7f8d8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff946840d26c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d92ffd640 1 -- 172.21.15.5:0/3791399544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880aa5f0 con 0x7f8d940b3cc0 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d92ffd640 1 -- 172.21.15.5:0/3791399544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d880aa750 con 0x7f8d940b3cc0 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d92ffd640 1 -- 172.21.15.5:0/3791399544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880aaae0 con 0x7f8d940b3cc0 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/3791399544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d940b3cc0 msgr2=0x7f8d9406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/3791399544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d940b3cc0 0x7f8d9406d3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d9406b8f0 tx=0x7f8d8801c490 comp rx=0 tx=0).stop 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/3791399544 shutdown_connections 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/3791399544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d940b3cc0 0x7f8d9406d3e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/3791399544 >> v2:172.21.15.102:3300/0 conn(0x7f8d9415d510 0x7f8d940b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.394+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/3791399544 >> 172.21.15.5:0/3791399544 conn(0x7f8d940b1e40 msgr2=0x7f8d94070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/3791399544 shutdown_connections 2023-11-24T07:57:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/3791399544 wait complete. 2023-11-24T07:57:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 Processor -- start 2023-11-24T07:57:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- start start 2023-11-24T07:57:37.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d9406d920 0x7f8d9414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d940b3cc0 0x7f8d940b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940cc320 con 0x7f8d9415d510 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940cc600 con 0x7f8d940b3cc0 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d9a4d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d940cc8e0 con 0x7f8d9406d920 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d93fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d9406d920 0x7f8d9414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56936/0 (socket says 172.21.15.5:56936) 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 -- 172.21.15.5:0/2081726593 learned_addr learned my addr 172.21.15.5:0/2081726593 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d937fe640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d940b3cc0 0x7f8d940b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 -- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d9406d920 msgr2=0x7f8d9414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d9406d920 0x7f8d9414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 -- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d940b3cc0 msgr2=0x7f8d940b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d940b3cc0 0x7f8d940b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 -- 172.21.15.5:0/2081726593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880094d0 con 0x7f8d9415d510 2023-11-24T07:57:37.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.398+0000 7f8d98a73640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00c780 tx=0x7f8d8c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00aa50 con 0x7f8d9415d510 2023-11-24T07:57:37.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00abf0 con 0x7f8d9415d510 2023-11-24T07:57:37.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d940ccbc0 con 0x7f8d9415d510 2023-11-24T07:57:37.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00ce30 con 0x7f8d9415d510 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d940ce000 con 0x7f8d9415d510 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9404e850 con 0x7f8d9415d510 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d8c012420 con 0x7f8d9415d510 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d8c083c40 con 0x7f8d9415d510 2023-11-24T07:57:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.402+0000 7f8d93fff640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.406+0000 7f8d93fff640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 0x7f8d80068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d840079c0 tx=0x7f8d84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.406+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d8c051420 con 0x7f8d9415d510 2023-11-24T07:57:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.618+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8d940cd070 con 0x7f8d9415d510 2023-11-24T07:57:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.618+0000 7f8d90ff9640 1 -- 172.21.15.5:0/2081726593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8d8c003eb0 con 0x7f8d9415d510 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2Bl4QpJFhAAyz/qcOCL6jqeZwabZzpyUA==", 2023-11-24T07:57:37.620 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlCtqfIhAAj+DC194fUct8AC1DOayDTQ==", 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-11-24T07:57:37.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2Blb/7MHRAAEF1xQBfcaM7Sxh4OsI4VDw==", 2023-11-24T07:57:37.623 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlGPnhKRAAKzChmMPsAcrUp5DAzjTgtg==", 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-11-24T07:57:37.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAEV2BlYUbrERAAQddiI7KVqeeXw002/LtxQg==", 2023-11-24T07:57:37.626 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAHV2BlJSMvGhAAhxmDmsraZdk0ubMQs8zlUQ==", 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.628 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKV2BlGnIPIRAAyarO4kk2ix3oxo57wnf8Zw==", 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQANV2BlNGyCJhAAzMnKPqoIUEhDMRKIi/PlIA==", 2023-11-24T07:57:37.630 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-11-24T07:57:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQATV2BlZGCoLxAA/QJZTDoqFZec/oukWz0dHg==", 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAWV2BlGEJSNhAAH7W6G2w5lg26TSCbC/hcfA==", 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAaV2BlVSkZARAAQJa9KvzDuv6DplGBfalPbw==", 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAdV2BlO7P8BhAAznHNHg+UsGEcKkL58su5nQ==", 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlLr0xLhAAi9XusKKnaV2O6GgqSb1tVQ==", 2023-11-24T07:57:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlHRPnNxAAVXN7CHPAalCgLCBd5qCi9A==", 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-11-24T07:57:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2Bl8kqLNBAAg2h8ba0Z3XuMm6QbmUI9iA==", 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQADV2BlJds4AhAAde7b1KkXbv8KkkDbWbwgJw==", 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-11-24T07:57:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQABV2BlsNcoNRAApXmO695hz5lNDxdZlFaQFQ==", 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2023-11-24T07:57:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2BlYdncCRAA8jRZS/yv5tTntwCPRrICmg==", 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2BlBObcCRAAjEIdyAGeM8vHhCK7dEsXtg==", 2023-11-24T07:57:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2Bl2+7cCRAAWERzJAn07Jq5O6wN0qdwKA==", 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2BlDPjcCRAAr+oqmigLxW5n4Z7E8qe/Fg==", 2023-11-24T07:57:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2BlpQDdCRAAk4FOjAvjhmXohFaqOsIIQg==", 2023-11-24T07:57:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAoV2BlzgndCRAA/U4A+ABrau2M/a1Je7j4mA==", 2023-11-24T07:57:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlpzMTERAACmqFWBppwQ66sKgZLBCInw==", 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQACV2BlhCluDRAAhpP/EW3SMpt0vnnNFIQhUw==", 2023-11-24T07:57:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:57:37.651 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 msgr2=0x7f8d80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 0x7f8d80068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d840079c0 tx=0x7f8d84008040 comp rx=0 tx=0).stop 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 msgr2=0x7f8d940b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00c780 tx=0x7f8d8c00cc40 comp rx=0 tx=0).stop 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 shutdown_connections 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9415d510 0x7f8d940b0a50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d940b3cc0 0x7f8d940b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 --2- 172.21.15.5:0/2081726593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d9406d920 0x7f8d9414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 >> 172.21.15.5:0/2081726593 conn(0x7f8d940b1e40 msgr2=0x7f8d9415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 shutdown_connections 2023-11-24T07:57:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.622+0000 7f8d9a4d6640 1 -- 172.21.15.5:0/2081726593 wait complete. 2023-11-24T07:57:37.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T07:57:37.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 Processor -- start 2023-11-24T07:57:37.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 -- start start 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd5380b07a0 0x7fd5381619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 0x7fd5380b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd538161290 con 0x7fd5380b2870 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5380b0b80 con 0x7fd5380b07a0 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53e2e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53815ebc0 con 0x7fd538161f20 2023-11-24T07:57:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53c880640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5380b2870 0x7fd5380cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38412/0 (socket says 172.21.15.5:38412) 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.798+0000 7fd53c880640 1 -- 172.21.15.5:0/583914228 learned_addr learned my addr 172.21.15.5:0/583914228 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 --2- 172.21.15.5:0/583914228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 0x7fd5380b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd537fff640 1 --2- 172.21.15.5:0/583914228 >> v2:172.21.15.102:3300/0 conn(0x7fd5380b07a0 0x7fd5381619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd536ffd640 1 -- 172.21.15.5:0/583914228 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100888572 0 0) 0x7fd538161290 con 0x7fd5380b2870 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd536ffd640 1 -- 172.21.15.5:0/583914228 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd520003530 con 0x7fd5380b2870 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 -- 172.21.15.5:0/583914228 >> v2:172.21.15.102:3300/0 conn(0x7fd5380b07a0 msgr2=0x7fd5381619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 --2- 172.21.15.5:0/583914228 >> v2:172.21.15.102:3300/0 conn(0x7fd5380b07a0 0x7fd5381619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 -- 172.21.15.5:0/583914228 >> v1:172.21.15.5:6789/0 conn(0x7fd5380b2870 legacy=0x7fd5380cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 -- 172.21.15.5:0/583914228 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538161550 con 0x7fd538161f20 2023-11-24T07:57:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd5377fe640 1 --2- 172.21.15.5:0/583914228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 0x7fd5380b0ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0097c0 tx=0x7fd52c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37021ce47b660346 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd536ffd640 1 -- 172.21.15.5:0/583914228 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0ab600 con 0x7fd538161f20 2023-11-24T07:57:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd536ffd640 1 -- 172.21.15.5:0/583914228 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0a7050 con 0x7fd538161f20 2023-11-24T07:57:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.802+0000 7fd536ffd640 1 -- 172.21.15.5:0/583914228 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0ab980 con 0x7fd538161f20 2023-11-24T07:57:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- 172.21.15.5:0/583914228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 msgr2=0x7fd5380b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/583914228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 0x7fd5380b0ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0097c0 tx=0x7fd52c01c480 comp rx=0 tx=0).stop 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- 172.21.15.5:0/583914228 shutdown_connections 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/583914228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd538161f20 0x7fd5380b0ee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/583914228 >> v2:172.21.15.102:3300/0 conn(0x7fd5380b07a0 0x7fd5381619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- 172.21.15.5:0/583914228 >> 172.21.15.5:0/583914228 conn(0x7fd5380b1d50 msgr2=0x7fd5380b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- 172.21.15.5:0/583914228 shutdown_connections 2023-11-24T07:57:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- 172.21.15.5:0/583914228 wait complete. 2023-11-24T07:57:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 Processor -- start 2023-11-24T07:57:37.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- start start 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5380b07a0 0x7fd5380afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5380b2870 0x7fd5380b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ad160 con 0x7fd538161f20 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ad440 con 0x7fd5380b2870 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53e2e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ad720 con 0x7fd5380b07a0 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.806+0000 7fd53c880640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56944/0 (socket says 172.21.15.5:56944) 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 -- 172.21.15.5:0/3396795569 learned_addr learned my addr 172.21.15.5:0/3396795569 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd5377fe640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5380b2870 0x7fd5380b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd537fff640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5380b07a0 0x7fd5380afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 -- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5380b07a0 msgr2=0x7fd5380afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5380b07a0 0x7fd5380afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 -- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5380b2870 msgr2=0x7fd5380b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5380b2870 0x7fd5380b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 -- 172.21.15.5:0/3396795569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009420 con 0x7fd538161f20 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53c880640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd53000cb40 tx=0x7fd53000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000aca0 con 0x7fd538161f20 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53000ae00 con 0x7fd538161f20 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5380ada00 con 0x7fd538161f20 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530012620 con 0x7fd538161f20 2023-11-24T07:57:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5380b5490 con 0x7fd538161f20 2023-11-24T07:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5380adc40 con 0x7fd538161f20 2023-11-24T07:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd530007070 con 0x7fd538161f20 2023-11-24T07:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.810+0000 7fd534ff9640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 0x7fd524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.814+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd530083a70 con 0x7fd538161f20 2023-11-24T07:57:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.814+0000 7fd537fff640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 0x7fd524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.814+0000 7fd537fff640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 0x7fd524068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd528009b60 tx=0x7fd528009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:37.818+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5380adc40 con 0x7fd538161f20 2023-11-24T07:57:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.034+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd5380adc40 con 0x7fd538161f20 2023-11-24T07:57:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.034+0000 7fd534ff9640 1 -- 172.21.15.5:0/3396795569 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5380adc40 con 0x7fd538161f20 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 msgr2=0x7fd524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 0x7fd524068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd528009b60 tx=0x7fd528009190 comp rx=0 tx=0).stop 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 msgr2=0x7fd5381556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd53000cb40 tx=0x7fd53000a060 comp rx=0 tx=0).stop 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 shutdown_connections 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd524066470 0x7fd524068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd538161f20 0x7fd5381556e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5380b2870 0x7fd5380b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 --2- 172.21.15.5:0/3396795569 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5380b07a0 0x7fd5380afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 >> 172.21.15.5:0/3396795569 conn(0x7fd5380b1d50 msgr2=0x7fd5380cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 shutdown_connections 2023-11-24T07:57:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.038+0000 7fd53e2e3640 1 -- 172.21.15.5:0/3396795569 wait complete. 2023-11-24T07:57:38.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T07:57:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.198+0000 7f0e6ce32640 1 Processor -- start 2023-11-24T07:57:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.198+0000 7f0e6ce32640 1 -- start start 2023-11-24T07:57:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6815d610 0x7f0e680ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 0x7f0e680cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e6806c520 0x7f0e6806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6806ceb0 con 0x7f0e6806c520 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680caec0 con 0x7f0e680caa60 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6ce32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6806b970 con 0x7f0e6815d610 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e6806c520 0x7f0e6806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e6806c520 0x7f0e6806c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56960/0 (socket says 172.21.15.5:56960) 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 -- 172.21.15.5:0/200612767 learned_addr learned my addr 172.21.15.5:0/200612767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e65d9b640 1 --2- 172.21.15.5:0/200612767 >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 0x7f0e680cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e6659c640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6815d610 0x7f0e680ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 -- 172.21.15.5:0/200612767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6815d610 msgr2=0x7f0e680ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6815d610 0x7f0e680ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 -- 172.21.15.5:0/200612767 >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 msgr2=0x7f0e680cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/200612767 >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 0x7f0e680cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e66d9d640 1 -- 172.21.15.5:0/200612767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6806bc50 con 0x7f0e6806c520 2023-11-24T07:57:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.202+0000 7f0e65d9b640 1 --2- 172.21.15.5:0/200612767 >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 0x7f0e680cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6806c520 0x7f0e6806c970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806f990 tx=0x7f0e6001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af093e77d3a6376c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6559a640 1 -- 172.21.15.5:0/200612767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600a5820 con 0x7f0e6806c520 2023-11-24T07:57:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6559a640 1 -- 172.21.15.5:0/200612767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600a5980 con 0x7f0e6806c520 2023-11-24T07:57:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6559a640 1 -- 172.21.15.5:0/200612767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600a5d10 con 0x7f0e6806c520 2023-11-24T07:57:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- 172.21.15.5:0/200612767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6806c520 msgr2=0x7f0e6806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6806c520 0x7f0e6806c970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806f990 tx=0x7f0e6001c9a0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- 172.21.15.5:0/200612767 shutdown_connections 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6806c520 0x7f0e6806c970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/200612767 >> v2:172.21.15.102:3300/0 conn(0x7f0e680caa60 0x7f0e680cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/200612767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6815d610 0x7f0e680ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- 172.21.15.5:0/200612767 >> 172.21.15.5:0/200612767 conn(0x7f0e680b2f10 msgr2=0x7f0e680b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- 172.21.15.5:0/200612767 shutdown_connections 2023-11-24T07:57:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- 172.21.15.5:0/200612767 wait complete. 2023-11-24T07:57:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 Processor -- start 2023-11-24T07:57:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.206+0000 7f0e6ce32640 1 -- start start 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 0x7f0e6814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e680caa60 0x7f0e6815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68149fe0 con 0x7f0e6815d610 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b4c90 con 0x7f0e680caa60 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6814a280 con 0x7f0e6806c520 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56964/0 (socket says 172.21.15.5:56964) 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 -- 172.21.15.5:0/783845 learned_addr learned my addr 172.21.15.5:0/783845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6659c640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 0x7f0e6814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e65d9b640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e680caa60 0x7f0e6815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 -- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 msgr2=0x7f0e6814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 0x7f0e6814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 -- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e680caa60 msgr2=0x7f0e6815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e680caa60 0x7f0e6815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 -- 172.21.15.5:0/783845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009b30 con 0x7f0e6815d610 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6659c640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 0x7f0e6814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e66d9d640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e600af040 tx=0x7f0e60019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600b8670 con 0x7f0e6815d610 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600b87f0 con 0x7f0e6815d610 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6814a560 con 0x7f0e6815d610 2023-11-24T07:57:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600b8ba0 con 0x7f0e6815d610 2023-11-24T07:57:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6814b2a0 con 0x7f0e6815d610 2023-11-24T07:57:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6814aa80 con 0x7f0e6815d610 2023-11-24T07:57:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.210+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e600b8d00 con 0x7f0e6815d610 2023-11-24T07:57:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.214+0000 7f0e56ffd640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 0x7f0e48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.214+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e6011f090 con 0x7f0e6815d610 2023-11-24T07:57:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.214+0000 7f0e6659c640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 0x7f0e48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.214+0000 7f0e6659c640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 0x7f0e48068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e681f95b0 tx=0x7f0e58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.218+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e6814aa80 con 0x7f0e6815d610 2023-11-24T07:57:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.430+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0e6814aa80 con 0x7f0e6815d610 2023-11-24T07:57:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.430+0000 7f0e56ffd640 1 -- 172.21.15.5:0/783845 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e6814aa80 con 0x7f0e6815d610 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 msgr2=0x7f0e48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 0x7f0e48068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e681f95b0 tx=0x7f0e58008040 comp rx=0 tx=0).stop 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 msgr2=0x7f0e68149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e600af040 tx=0x7f0e60019740 comp rx=0 tx=0).stop 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 shutdown_connections 2023-11-24T07:57:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e48066470 0x7f0e48068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e6815d610 0x7f0e68149440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e680caa60 0x7f0e6815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 --2- 172.21.15.5:0/783845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e6806c520 0x7f0e6814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 >> 172.21.15.5:0/783845 conn(0x7f0e680b2f10 msgr2=0x7f0e680b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 shutdown_connections 2023-11-24T07:57:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.434+0000 7f0e6ce32640 1 -- 172.21.15.5:0/783845 wait complete. 2023-11-24T07:57:38.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T07:57:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 Processor -- start 2023-11-24T07:57:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 -- start start 2023-11-24T07:57:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 0x7f018815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188159630 con 0x7f01880cb9b0 2023-11-24T07:57:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018806e860 con 0x7f018806e3f0 2023-11-24T07:57:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018e416640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018815bba0 con 0x7f01880ce5d0 2023-11-24T07:57:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f01877fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 0x7f018815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:41816/0 (socket says 172.21.15.5:41816) 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 -- 172.21.15.5:0/4056465345 learned_addr learned my addr 172.21.15.5:0/4056465345 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 -- 172.21.15.5:0/4056465345 >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 msgr2=0x7f018815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 --2- 172.21.15.5:0/4056465345 >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 0x7f018815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 -- 172.21.15.5:0/4056465345 >> v1:172.21.15.102:6789/0 conn(0x7f01880cb9b0 legacy=0x7f01880cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f018c9b3640 1 -- 172.21.15.5:0/4056465345 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018815f6d0 con 0x7f01880ce5d0 2023-11-24T07:57:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.598+0000 7f01877fe640 1 --2- 172.21.15.5:0/4056465345 >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 0x7f018815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018c9b3640 1 --2- 172.21.15.5:0/4056465345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7411536a6b0903 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f0186ffd640 1 -- 172.21.15.5:0/4056465345 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800a57b0 con 0x7f01880ce5d0 2023-11-24T07:57:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f0186ffd640 1 -- 172.21.15.5:0/4056465345 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800a5910 con 0x7f01880ce5d0 2023-11-24T07:57:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f0186ffd640 1 -- 172.21.15.5:0/4056465345 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800a5ca0 con 0x7f01880ce5d0 2023-11-24T07:57:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 -- 172.21.15.5:0/4056465345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 msgr2=0x7f018815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 --2- 172.21.15.5:0/4056465345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018001ca10 comp rx=0 tx=0).stop 2023-11-24T07:57:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 -- 172.21.15.5:0/4056465345 shutdown_connections 2023-11-24T07:57:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 --2- 172.21.15.5:0/4056465345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880ce5d0 0x7f018815bfd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 --2- 172.21.15.5:0/4056465345 >> v2:172.21.15.102:3300/0 conn(0x7f018806e3f0 0x7f018815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 -- 172.21.15.5:0/4056465345 >> 172.21.15.5:0/4056465345 conn(0x7f01880b0cb0 msgr2=0x7f01880b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 -- 172.21.15.5:0/4056465345 shutdown_connections 2023-11-24T07:57:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.602+0000 7f018e416640 1 -- 172.21.15.5:0/4056465345 wait complete. 2023-11-24T07:57:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 Processor -- start 2023-11-24T07:57:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- start start 2023-11-24T07:57:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f018806e3f0 0x7f0188144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01880ce5d0 0x7f01881585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188144570 con 0x7f01880cb9b0 2023-11-24T07:57:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018809b710 con 0x7f01880ce5d0 2023-11-24T07:57:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188146d00 con 0x7f018806e3f0 2023-11-24T07:57:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56966/0 (socket says 172.21.15.5:56966) 2023-11-24T07:57:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 -- 172.21.15.5:0/2060060296 learned_addr learned my addr 172.21.15.5:0/2060060296 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018c9b3640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01880ce5d0 0x7f01881585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f0187fff640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f018806e3f0 0x7f0188144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 -- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f018806e3f0 msgr2=0x7f0188144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f018806e3f0 0x7f0188144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 -- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01880ce5d0 msgr2=0x7f01881585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01880ce5d0 0x7f01881585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 -- 172.21.15.5:0/2060060296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c009420 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f01877fe640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f017c00ebe0 tx=0x7f017c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00eee0 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00cc30 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180009b30 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c013470 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.606+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01881472c0 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01880671f0 con 0x7f01880cb9b0 2023-11-24T07:57:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f017c0135d0 con 0x7f01880cb9b0 2023-11-24T07:57:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f0184ff9640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 0x7f0174068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f017c083de0 con 0x7f01880cb9b0 2023-11-24T07:57:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f0187fff640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 0x7f0174068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.610+0000 7f0187fff640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 0x7f0174068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.614+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f017c0515c0 con 0x7f01880cb9b0 2023-11-24T07:57:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.826+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f018806b460 con 0x7f01880cb9b0 2023-11-24T07:57:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.830+0000 7f0184ff9640 1 -- 172.21.15.5:0/2060060296 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f017c054be0 con 0x7f01880cb9b0 2023-11-24T07:57:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 msgr2=0x7f0174068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 0x7f0174068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178009040 comp rx=0 tx=0).stop 2023-11-24T07:57:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 msgr2=0x7f0188099ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f017c00ebe0 tx=0x7f017c00c520 comp rx=0 tx=0).stop 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 shutdown_connections 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0174066470 0x7f0174068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01880ce5d0 0x7f01881585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01880cb9b0 0x7f0188099ac0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 --2- 172.21.15.5:0/2060060296 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f018806e3f0 0x7f0188144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 >> 172.21.15.5:0/2060060296 conn(0x7f01880b0cb0 msgr2=0x7f01881655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 shutdown_connections 2023-11-24T07:57:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.834+0000 7f018e416640 1 -- 172.21.15.5:0/2060060296 wait complete. 2023-11-24T07:57:38.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T07:57:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 Processor -- start 2023-11-24T07:57:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 -- start start 2023-11-24T07:57:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcffc06cc30 0x7fcffc0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0cbfe0 con 0x7fcffc0ce4b0 2023-11-24T07:57:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc06b970 con 0x7fcffc15d610 2023-11-24T07:57:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fd00192a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc06bc50 con 0x7fcffc06cc30 2023-11-24T07:57:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcffb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcffc06cc30 0x7fcffc0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcff3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcffc0ce4b0 0x7fcffc06c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38426/0 (socket says 172.21.15.5:38426) 2023-11-24T07:57:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcff3fff640 1 -- 172.21.15.5:0/2336638046 learned_addr learned my addr 172.21.15.5:0/2336638046 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcffb7fe640 1 -- 172.21.15.5:0/2336638046 >> v1:172.21.15.102:6789/0 conn(0x7fcffc15d610 legacy=0x7fcffc0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcffb7fe640 1 -- 172.21.15.5:0/2336638046 >> v1:172.21.15.5:6789/0 conn(0x7fcffc0ce4b0 legacy=0x7fcffc06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcffa7fc640 1 -- 172.21.15.5:0/2336638046 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621090190 0 0) 0x7fcffc0cbfe0 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:38.998+0000 7fcffb7fe640 1 -- 172.21.15.5:0/2336638046 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0cfe60 con 0x7fcffc06cc30 2023-11-24T07:57:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fcffb7fe640 1 --2- 172.21.15.5:0/2336638046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06cc30 0x7fcffc0caa60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009d90 tx=0x7fcff401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94190de6a15d5b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fcffa7fc640 1 -- 172.21.15.5:0/2336638046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40a57d0 con 0x7fcffc06cc30 2023-11-24T07:57:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fcffa7fc640 1 -- 172.21.15.5:0/2336638046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff40a5930 con 0x7fcffc06cc30 2023-11-24T07:57:39.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fcffa7fc640 1 -- 172.21.15.5:0/2336638046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40a5cc0 con 0x7fcffc06cc30 2023-11-24T07:57:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 -- 172.21.15.5:0/2336638046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06cc30 msgr2=0x7fcffc0caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 --2- 172.21.15.5:0/2336638046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06cc30 0x7fcffc0caa60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009d90 tx=0x7fcff401c950 comp rx=0 tx=0).stop 2023-11-24T07:57:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 -- 172.21.15.5:0/2336638046 shutdown_connections 2023-11-24T07:57:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 --2- 172.21.15.5:0/2336638046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06cc30 0x7fcffc0caa60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 -- 172.21.15.5:0/2336638046 >> 172.21.15.5:0/2336638046 conn(0x7fcffc0b2f10 msgr2=0x7fcffc0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:39.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 -- 172.21.15.5:0/2336638046 shutdown_connections 2023-11-24T07:57:39.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.002+0000 7fd00192a640 1 -- 172.21.15.5:0/2336638046 wait complete. 2023-11-24T07:57:39.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 Processor -- start 2023-11-24T07:57:39.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- start start 2023-11-24T07:57:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 0x7fcffc160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcffc15d610 0x7fcffc14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc160e70 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc14f7a0 con 0x7fcffc06cc30 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc160ba0 con 0x7fcffc15d610 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56988/0 (socket says 172.21.15.5:56988) 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 -- 172.21.15.5:0/2768845859 learned_addr learned my addr 172.21.15.5:0/2768845859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcffaffd640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 0x7fcffc160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcffb7fe640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcffc15d610 0x7fcffc14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 -- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcffc15d610 msgr2=0x7fcffc14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcffc15d610 0x7fcffc14eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 -- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 msgr2=0x7fcffc160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 0x7fcffc160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 -- 172.21.15.5:0/2768845859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff4009a70 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcffaffd640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 0x7fcffc160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff3fff640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c4a0 tx=0x7fcfe400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40074e0 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4007640 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc153b40 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004a30 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc154100 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.006+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc04e850 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.010+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfe4004b90 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.010+0000 7fcff8ff9640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.010+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfe4083040 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.010+0000 7fcffaffd640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.010+0000 7fcffaffd640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 0x7fcfdc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007fd0 tx=0x7fcfec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.014+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfe40b4280 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.230+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fcffc0cd460 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.230+0000 7fcff8ff9640 1 -- 172.21.15.5:0/2768845859 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcfe4018020 con 0x7fcffc0ce4b0 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 msgr2=0x7fcfdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 0x7fcfdc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007fd0 tx=0x7fcfec009040 comp rx=0 tx=0).stop 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 msgr2=0x7fcffc0d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c4a0 tx=0x7fcfe400c960 comp rx=0 tx=0).stop 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 shutdown_connections 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcffc15d610 0x7fcffc14eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc0ce4b0 0x7fcffc0d1700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 --2- 172.21.15.5:0/2768845859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcffc06cc30 0x7fcffc160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 >> 172.21.15.5:0/2768845859 conn(0x7fcffc0b2f10 msgr2=0x7fcffc15c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 shutdown_connections 2023-11-24T07:57:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.234+0000 7fd00192a640 1 -- 172.21.15.5:0/2768845859 wait complete. 2023-11-24T07:57:39.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T07:57:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 Processor -- start 2023-11-24T07:57:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 -- start start 2023-11-24T07:57:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cdfb0 0x7f560c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c15a710 0x7f560c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0ce8d0 con 0x7f560c0cbd50 2023-11-24T07:57:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0cca80 con 0x7f560c15a710 2023-11-24T07:57:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f5612794640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b2710 con 0x7f560c0cdfb0 2023-11-24T07:57:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c15a710 0x7f560c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c15a710 0x7f560c0ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56996/0 (socket says 172.21.15.5:56996) 2023-11-24T07:57:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 -- 172.21.15.5:0/2134665152 learned_addr learned my addr 172.21.15.5:0/2134665152 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560bfff640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cdfb0 0x7f560c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 -- 172.21.15.5:0/2134665152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cdfb0 msgr2=0x7f560c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cdfb0 0x7f560c0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 -- 172.21.15.5:0/2134665152 >> v1:172.21.15.102:6789/0 conn(0x7f560c0cbd50 legacy=0x7f560c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.398+0000 7f560b7fe640 1 -- 172.21.15.5:0/2134665152 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0b29f0 con 0x7f560c15a710 2023-11-24T07:57:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f560b7fe640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c15a710 0x7f560c0ce390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3883a84a352d824e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f560affd640 1 -- 172.21.15.5:0/2134665152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000aa670 con 0x7f560c15a710 2023-11-24T07:57:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f560affd640 1 -- 172.21.15.5:0/2134665152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000aa7d0 con 0x7f560c15a710 2023-11-24T07:57:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f560affd640 1 -- 172.21.15.5:0/2134665152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000aab60 con 0x7f560c15a710 2023-11-24T07:57:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 -- 172.21.15.5:0/2134665152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c15a710 msgr2=0x7f560c0ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c15a710 0x7f560c0ce390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c510 comp rx=0 tx=0).stop 2023-11-24T07:57:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 -- 172.21.15.5:0/2134665152 shutdown_connections 2023-11-24T07:57:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c15a710 0x7f560c0ce390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 --2- 172.21.15.5:0/2134665152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cdfb0 0x7f560c0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 -- 172.21.15.5:0/2134665152 >> 172.21.15.5:0/2134665152 conn(0x7f560c0b0cb0 msgr2=0x7f560c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 -- 172.21.15.5:0/2134665152 shutdown_connections 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.402+0000 7f5612794640 1 -- 172.21.15.5:0/2134665152 wait complete. 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 Processor -- start 2023-11-24T07:57:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- start start 2023-11-24T07:57:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cbd50 0x7f560c154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f560c15a710 0x7f560c158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0aff80 con 0x7f560c0cdfb0 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0afca0 con 0x7f560c15a710 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1559d0 con 0x7f560c0cbd50 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57002/0 (socket says 172.21.15.5:57002) 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 -- 172.21.15.5:0/857740099 learned_addr learned my addr 172.21.15.5:0/857740099 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560bfff640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cbd50 0x7f560c154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5610d31640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f560c15a710 0x7f560c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 -- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cbd50 msgr2=0x7f560c154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cbd50 0x7f560c154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 -- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f560c15a710 msgr2=0x7f560c158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f560c15a710 0x7f560c158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 -- 172.21.15.5:0/857740099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000094d0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f560b7fe640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f560001a140 tx=0x7f560001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b3800 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000b3980 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c155cb0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b3d30 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.406+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c1553f0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c0671f0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56000c6440 con 0x7f560c0cdfb0 2023-11-24T07:57:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f5608ff9640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 0x7f55f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f560011e750 con 0x7f560c0cdfb0 2023-11-24T07:57:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f560bfff640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 0x7f55f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.410+0000 7f560bfff640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 0x7f55f8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00b240 tx=0x7f55fc00b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.414+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56000ebfc0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.634+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f560c1561d0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5608ff9640 1 -- 172.21.15.5:0/857740099 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f560c1561d0 con 0x7f560c0cdfb0 2023-11-24T07:57:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 msgr2=0x7f55f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 0x7f55f8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00b240 tx=0x7f55fc00b3a0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 msgr2=0x7f560c158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f560001a140 tx=0x7f560001ad50 comp rx=0 tx=0).stop 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 shutdown_connections 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f55f8066470 0x7f55f8068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f560c15a710 0x7f560c158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0cdfb0 0x7f560c158100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 --2- 172.21.15.5:0/857740099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f560c0cbd50 0x7f560c154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 >> 172.21.15.5:0/857740099 conn(0x7f560c0b0cb0 msgr2=0x7f560c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 shutdown_connections 2023-11-24T07:57:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.638+0000 7f5612794640 1 -- 172.21.15.5:0/857740099 wait complete. 2023-11-24T07:57:39.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T07:57:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 Processor -- start 2023-11-24T07:57:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 -- start start 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec146820 0x7f35ec070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec147190 con 0x7f35ec0b4210 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec06d030 con 0x7f35ec15eb50 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.802+0000 7f35f2417640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec161fa0 con 0x7f35ec146820 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec146820 0x7f35ec070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f35ec0b4210 0x7f35ec161180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38434/0 (socket says 172.21.15.5:38434) 2023-11-24T07:57:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35ec146820 0x7f35ec070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57004/0 (socket says 172.21.15.5:57004) 2023-11-24T07:57:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eb7fe640 1 -- 172.21.15.5:0/1894346362 learned_addr learned my addr 172.21.15.5:0/1894346362 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 -- 172.21.15.5:0/1894346362 >> v1:172.21.15.102:6789/0 conn(0x7f35ec15eb50 legacy=0x7f35ec161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 -- 172.21.15.5:0/1894346362 >> v1:172.21.15.5:6789/0 conn(0x7f35ec0b4210 legacy=0x7f35ec161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 -- 172.21.15.5:0/1894346362 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec146c00 con 0x7f35ec146820 2023-11-24T07:57:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eaffd640 1 -- 172.21.15.5:0/1894346362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530189318 0 0) 0x7f35ec147190 con 0x7f35ec0b4210 2023-11-24T07:57:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35ebfff640 1 --2- 172.21.15.5:0/1894346362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec146820 0x7f35ec070a50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f35ec146df0 tx=0x7f35dc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e80c01d33c4cf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eaffd640 1 -- 172.21.15.5:0/1894346362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ab650 con 0x7f35ec146820 2023-11-24T07:57:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eaffd640 1 -- 172.21.15.5:0/1894346362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0ab7b0 con 0x7f35ec146820 2023-11-24T07:57:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.806+0000 7f35eaffd640 1 -- 172.21.15.5:0/1894346362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0abb40 con 0x7f35ec146820 2023-11-24T07:57:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- 172.21.15.5:0/1894346362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec146820 msgr2=0x7f35ec070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 --2- 172.21.15.5:0/1894346362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec146820 0x7f35ec070a50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f35ec146df0 tx=0x7f35dc01c450 comp rx=0 tx=0).stop 2023-11-24T07:57:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- 172.21.15.5:0/1894346362 shutdown_connections 2023-11-24T07:57:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 --2- 172.21.15.5:0/1894346362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec146820 0x7f35ec070a50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- 172.21.15.5:0/1894346362 >> 172.21.15.5:0/1894346362 conn(0x7f35ec0b2f10 msgr2=0x7f35ec0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- 172.21.15.5:0/1894346362 shutdown_connections 2023-11-24T07:57:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- 172.21.15.5:0/1894346362 wait complete. 2023-11-24T07:57:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 Processor -- start 2023-11-24T07:57:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- start start 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 0x7f35ec15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35ec15eb50 0x7f35ec13bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec140400 con 0x7f35ec0b4210 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec13f860 con 0x7f35ec146820 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35f2417640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec13fad0 con 0x7f35ec15eb50 2023-11-24T07:57:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57014/0 (socket says 172.21.15.5:57014) 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35ebfff640 1 -- 172.21.15.5:0/1351893665 learned_addr learned my addr 172.21.15.5:0/1351893665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35ebfff640 1 -- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35ec15eb50 msgr2=0x7f35ec13bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.810+0000 7f35ebfff640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35ec15eb50 0x7f35ec13bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 0x7f35ec15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35ebfff640 1 -- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 msgr2=0x7f35ec15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35ebfff640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 0x7f35ec15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35ebfff640 1 -- 172.21.15.5:0/1351893665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009420 con 0x7f35ec0b4210 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 0x7f35ec15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35ebfff640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f35dc01a080 tx=0x7f35dc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0b5810 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0b5990 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0b5d40 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec13fdb0 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec13d8a0 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec13da90 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35dc0b4390 con 0x7f35ec0b4210 2023-11-24T07:57:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 0x7f35d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35dc11e690 con 0x7f35ec0b4210 2023-11-24T07:57:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.814+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 0x7f35d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.818+0000 7f35eb7fe640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 0x7f35d8068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f35ec145bc0 tx=0x7f35e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:39.818+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35ec13da90 con 0x7f35ec0b4210 2023-11-24T07:57:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.034+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f35ec13da90 con 0x7f35ec0b4210 2023-11-24T07:57:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35e8ff9640 1 -- 172.21.15.5:0/1351893665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f35ec13da90 con 0x7f35ec0b4210 2023-11-24T07:57:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 msgr2=0x7f35d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 0x7f35d8068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f35ec145bc0 tx=0x7f35e0009040 comp rx=0 tx=0).stop 2023-11-24T07:57:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 msgr2=0x7f35ec13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f35dc01a080 tx=0x7f35dc01ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 shutdown_connections 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35d8066470 0x7f35d8068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35ec15eb50 0x7f35ec13bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35ec146820 0x7f35ec15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 --2- 172.21.15.5:0/1351893665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35ec0b4210 0x7f35ec13d360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 >> 172.21.15.5:0/1351893665 conn(0x7f35ec0b2f10 msgr2=0x7f35ec0b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 shutdown_connections 2023-11-24T07:57:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.038+0000 7f35f2417640 1 -- 172.21.15.5:0/1351893665 wait complete. 2023-11-24T07:57:40.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 Processor -- start 2023-11-24T07:57:40.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 -- start start 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc158144c80 0x7fc1580abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1580ac460 0x7fc1580706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc158145060 con 0x7fc158070c20 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc158071fd0 con 0x7fc1580ac460 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15d0d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580ac8c0 con 0x7fc158144c80 2023-11-24T07:57:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc14ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1580ac460 0x7fc1580706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15759e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc158070c20 0x7fc15815eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38440/0 (socket says 172.21.15.5:38440) 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc15759e640 1 -- 172.21.15.5:0/2748223010 learned_addr learned my addr 172.21.15.5:0/2748223010 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc14ffff640 1 -- 172.21.15.5:0/2748223010 >> v2:172.21.15.102:3300/0 conn(0x7fc158144c80 msgr2=0x7fc1580abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc14ffff640 1 --2- 172.21.15.5:0/2748223010 >> v2:172.21.15.102:3300/0 conn(0x7fc158144c80 0x7fc1580abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc14ffff640 1 -- 172.21.15.5:0/2748223010 >> v1:172.21.15.5:6789/0 conn(0x7fc158070c20 legacy=0x7fc15815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.202+0000 7fc14ffff640 1 -- 172.21.15.5:0/2748223010 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158071450 con 0x7fc1580ac460 2023-11-24T07:57:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc14ffff640 1 --2- 172.21.15.5:0/2748223010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580706e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc15806eb80 tx=0x7fc14001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bef42aec26f886 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15659c640 1 -- 172.21.15.5:0/2748223010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400a7070 con 0x7fc1580ac460 2023-11-24T07:57:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15659c640 1 -- 172.21.15.5:0/2748223010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400ab430 con 0x7fc1580ac460 2023-11-24T07:57:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15659c640 1 -- 172.21.15.5:0/2748223010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400ab7c0 con 0x7fc1580ac460 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 -- 172.21.15.5:0/2748223010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 msgr2=0x7fc1580706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/2748223010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580706e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc15806eb80 tx=0x7fc14001c430 comp rx=0 tx=0).stop 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 -- 172.21.15.5:0/2748223010 shutdown_connections 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/2748223010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580706e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/2748223010 >> v2:172.21.15.102:3300/0 conn(0x7fc158144c80 0x7fc1580abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 -- 172.21.15.5:0/2748223010 >> 172.21.15.5:0/2748223010 conn(0x7fc1580b0c40 msgr2=0x7fc1580b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 -- 172.21.15.5:0/2748223010 shutdown_connections 2023-11-24T07:57:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 -- 172.21.15.5:0/2748223010 wait complete. 2023-11-24T07:57:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.206+0000 7fc15d0d6640 1 Processor -- start 2023-11-24T07:57:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- start start 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc158070c20 0x7fc15815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc158144c80 0x7fc1580b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580b2d30 con 0x7fc1580ac460 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15815da20 con 0x7fc158144c80 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15815b270 con 0x7fc158070c20 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57034/0 (socket says 172.21.15.5:57034) 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 -- 172.21.15.5:0/3582084462 learned_addr learned my addr 172.21.15.5:0/3582084462 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc156d9d640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc158070c20 0x7fc15815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15759e640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc158144c80 0x7fc1580b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 -- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc158070c20 msgr2=0x7fc15815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc158070c20 0x7fc15815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 -- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc158144c80 msgr2=0x7fc1580b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc158144c80 0x7fc1580b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 -- 172.21.15.5:0/3582084462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009420 con 0x7fc1580ac460 2023-11-24T07:57:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14ffff640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ad040 tx=0x7fc14001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400b5810 con 0x7fc1580ac460 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400b5990 con 0x7fc1580ac460 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400b5d40 con 0x7fc1580ac460 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1581643d0 con 0x7fc1580ac460 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15815df50 con 0x7fc1580ac460 2023-11-24T07:57:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.210+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1580b1ba0 con 0x7fc1580ac460 2023-11-24T07:57:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.214+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1400b4390 con 0x7fc1580ac460 2023-11-24T07:57:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.214+0000 7fc14f7fe640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 0x7fc138068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.214+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc14011e580 con 0x7fc1580ac460 2023-11-24T07:57:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.214+0000 7fc156d9d640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 0x7fc138068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.214+0000 7fc156d9d640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 0x7fc138068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc1480098f0 tx=0x7fc148006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.218+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1400ebf10 con 0x7fc1580ac460 2023-11-24T07:57:40.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc15804e850 con 0x7fc1580ac460 2023-11-24T07:57:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc14f7fe640 1 -- 172.21.15.5:0/3582084462 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12809 (secure 0 0 0) 0x7fc1400ef530 con 0x7fc1580ac460 2023-11-24T07:57:40.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:40.378 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:37.216961+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 msgr2=0x7fc138068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 0x7fc138068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc1480098f0 tx=0x7fc148006f90 comp rx=0 tx=0).stop 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 msgr2=0x7fc1580b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ad040 tx=0x7fc14001ac70 comp rx=0 tx=0).stop 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 shutdown_connections 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc138066470 0x7fc138068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc158144c80 0x7fc1580b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1580ac460 0x7fc1580b2040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 --2- 172.21.15.5:0/3582084462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc158070c20 0x7fc15815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 >> 172.21.15.5:0/3582084462 conn(0x7fc1580b0c40 msgr2=0x7fc1580add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 shutdown_connections 2023-11-24T07:57:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.378+0000 7fc15d0d6640 1 -- 172.21.15.5:0/3582084462 wait complete. 2023-11-24T07:57:40.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:40.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 Processor -- start 2023-11-24T07:57:40.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 -- start start 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f121c0b15f0 0x7f121c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c161290 con 0x7f121c0b2870 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c161550 con 0x7f121c0b07a0 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1223e9a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c0b0b80 con 0x7f121c0b15f0 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1221435640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f121c0b2870 0x7f121c0b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38452/0 (socket says 172.21.15.5:38452) 2023-11-24T07:57:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1221435640 1 -- 172.21.15.5:0/2306320716 learned_addr learned my addr 172.21.15.5:0/2306320716 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1222437640 1 --2- 172.21.15.5:0/2306320716 >> v2:172.21.15.5:3300/0 conn(0x7f121c0b15f0 0x7f121c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.546+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897648849 0 0) 0x7f121c161290 con 0x7f121c0b2870 2023-11-24T07:57:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1208003530 con 0x7f121c0b2870 2023-11-24T07:57:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237560371 0 0) 0x7f121c161550 con 0x7f121c0b07a0 2023-11-24T07:57:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c161290 con 0x7f121c0b07a0 2023-11-24T07:57:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1222437640 1 -- 172.21.15.5:0/2306320716 >> v1:172.21.15.102:6789/0 conn(0x7f121c0b07a0 legacy=0x7f121c1619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1222437640 1 -- 172.21.15.5:0/2306320716 >> v1:172.21.15.5:6789/0 conn(0x7f121c0b2870 legacy=0x7f121c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1222437640 1 -- 172.21.15.5:0/2306320716 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0c65a0 con 0x7f121c0b15f0 2023-11-24T07:57:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1222437640 1 --2- 172.21.15.5:0/2306320716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cc9a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5ef3b74a2abee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140a5900 con 0x7f121c0b15f0 2023-11-24T07:57:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12140a5a60 con 0x7f121c0b15f0 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1220c34640 1 -- 172.21.15.5:0/2306320716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140a5df0 con 0x7f121c0b15f0 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1223e9a640 1 -- 172.21.15.5:0/2306320716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 msgr2=0x7f121c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1223e9a640 1 --2- 172.21.15.5:0/2306320716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cc9a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1214009d90 tx=0x7f121401c950 comp rx=0 tx=0).stop 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1223e9a640 1 -- 172.21.15.5:0/2306320716 shutdown_connections 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1223e9a640 1 --2- 172.21.15.5:0/2306320716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cc9a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.550+0000 7f1223e9a640 1 -- 172.21.15.5:0/2306320716 >> 172.21.15.5:0/2306320716 conn(0x7f121c0b1d50 msgr2=0x7f121c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- 172.21.15.5:0/2306320716 shutdown_connections 2023-11-24T07:57:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- 172.21.15.5:0/2306320716 wait complete. 2023-11-24T07:57:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 Processor -- start 2023-11-24T07:57:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- start start 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f121c0b07a0 0x7f121c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c0b2870 0x7f121c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0ad4b0 con 0x7f121c0b15f0 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c159270 con 0x7f121c0b2870 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0adeb0 con 0x7f121c0b07a0 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57054/0 (socket says 172.21.15.5:57054) 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 -- 172.21.15.5:0/926518416 learned_addr learned my addr 172.21.15.5:0/926518416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221c36640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f121c0b07a0 0x7f121c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1222437640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c0b2870 0x7f121c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 -- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f121c0b07a0 msgr2=0x7f121c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f121c0b07a0 0x7f121c1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 -- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c0b2870 msgr2=0x7f121c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c0b2870 0x7f121c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 -- 172.21.15.5:0/926518416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009a70 con 0x7f121c0b15f0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1221435640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f120c005890 tx=0x7f120c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c005cf0 con 0x7f121c0b15f0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c005e50 con 0x7f121c0b15f0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c007310 con 0x7f121c0b15f0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c0ad1d0 con 0x7f121c0b15f0 2023-11-24T07:57:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.554+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c156700 con 0x7f121c0b15f0 2023-11-24T07:57:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c0ad9a0 con 0x7f121c0b15f0 2023-11-24T07:57:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f120c007470 con 0x7f121c0b15f0 2023-11-24T07:57:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f12127fc640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 0x7f1200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f120c0831d0 con 0x7f121c0b15f0 2023-11-24T07:57:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f1221c36640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 0x7f1200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.558+0000 7f1221c36640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 0x7f1200068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12180011f0 tx=0x7f1218009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.562+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f121c0ad9a0 con 0x7f121c0b15f0 2023-11-24T07:57:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.717+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f121c0ad9a0 con 0x7f121c0b15f0 2023-11-24T07:57:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f12127fc640 1 -- 172.21.15.5:0/926518416 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f121c0ad9a0 con 0x7f121c0b15f0 2023-11-24T07:57:40.721 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 msgr2=0x7f1200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 0x7f1200068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12180011f0 tx=0x7f1218009040 comp rx=0 tx=0).stop 2023-11-24T07:57:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 msgr2=0x7f121c0cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f120c005890 tx=0x7f120c00c8b0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 shutdown_connections 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1200066470 0x7f1200068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f121c0b2870 0x7f121c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0b15f0 0x7f121c0cf180 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 --2- 172.21.15.5:0/926518416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f121c0b07a0 0x7f121c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 >> 172.21.15.5:0/926518416 conn(0x7f121c0b1d50 msgr2=0x7f121c0ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 shutdown_connections 2023-11-24T07:57:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.721+0000 7f1223e9a640 1 -- 172.21.15.5:0/926518416 wait complete. 2023-11-24T07:57:40.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T07:57:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 Processor -- start 2023-11-24T07:57:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 -- start start 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe0000cead0 0x7fe0000d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0000d1eb0 0x7fe00006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000d22c0 con 0x7fe00015d7b0 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000d17e0 con 0x7fe0000d1eb0 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe006f57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000cefd0 con 0x7fe0000cead0 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0000d1eb0 0x7fe00006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe0000d1eb0 0x7fe00006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57068/0 (socket says 172.21.15.5:57068) 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 -- 172.21.15.5:0/3076653945 learned_addr learned my addr 172.21.15.5:0/3076653945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe004cf3640 1 --1- 172.21.15.5:0/3076653945 >> v1:172.21.15.5:6789/0 conn(0x7fe00015d7b0 0x7fe0000d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38460/0 (socket says 172.21.15.5:38460) 2023-11-24T07:57:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fdffffff640 1 --2- 172.21.15.5:0/3076653945 >> v2:172.21.15.102:3300/0 conn(0x7fe0000cead0 0x7fe0000d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 -- 172.21.15.5:0/3076653945 >> v2:172.21.15.102:3300/0 conn(0x7fe0000cead0 msgr2=0x7fe0000d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 --2- 172.21.15.5:0/3076653945 >> v2:172.21.15.102:3300/0 conn(0x7fe0000cead0 0x7fe0000d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 -- 172.21.15.5:0/3076653945 >> v1:172.21.15.5:6789/0 conn(0x7fe00015d7b0 legacy=0x7fe0000d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.885+0000 7fe0054f4640 1 -- 172.21.15.5:0/3076653945 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000cf2b0 con 0x7fe0000d1eb0 2023-11-24T07:57:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe0054f4640 1 --2- 172.21.15.5:0/3076653945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0000d1eb0 0x7fe00006bed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe00008ba60 tx=0x7fdff801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e121b8495510592a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fdfff7fe640 1 -- 172.21.15.5:0/3076653945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80a5740 con 0x7fe0000d1eb0 2023-11-24T07:57:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fdfff7fe640 1 -- 172.21.15.5:0/3076653945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff80a58a0 con 0x7fe0000d1eb0 2023-11-24T07:57:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fdfff7fe640 1 -- 172.21.15.5:0/3076653945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80a5c30 con 0x7fe0000d1eb0 2023-11-24T07:57:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 -- 172.21.15.5:0/3076653945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0000d1eb0 msgr2=0x7fe00006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 --2- 172.21.15.5:0/3076653945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0000d1eb0 0x7fe00006bed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe00008ba60 tx=0x7fdff801c880 comp rx=0 tx=0).stop 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 -- 172.21.15.5:0/3076653945 shutdown_connections 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 --2- 172.21.15.5:0/3076653945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0000d1eb0 0x7fe00006bed0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 --2- 172.21.15.5:0/3076653945 >> v2:172.21.15.102:3300/0 conn(0x7fe0000cead0 0x7fe0000d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 -- 172.21.15.5:0/3076653945 >> 172.21.15.5:0/3076653945 conn(0x7fe0000d33b0 msgr2=0x7fe0000d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 -- 172.21.15.5:0/3076653945 shutdown_connections 2023-11-24T07:57:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.889+0000 7fe006f57640 1 -- 172.21.15.5:0/3076653945 wait complete. 2023-11-24T07:57:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 Processor -- start 2023-11-24T07:57:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- start start 2023-11-24T07:57:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 0x7fe00015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 0x7fe0000c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000c9e60 con 0x7fe00015d7b0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000ca480 con 0x7fe0000d1eb0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000c99d0 con 0x7fe0000cead0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57080/0 (socket says 172.21.15.5:57080) 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 -- 172.21.15.5:0/1912253482 learned_addr learned my addr 172.21.15.5:0/1912253482 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fdffffff640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 0x7fe0000c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe004cf3640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 0x7fe00015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 -- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 msgr2=0x7fe00015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 0x7fe00015c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 -- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 msgr2=0x7fe0000c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 0x7fe0000c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 -- 172.21.15.5:0/1912253482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009b30 con 0x7fe00015d7b0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fdffffff640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 0x7fe0000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe004cf3640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 0x7fe00015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe0054f4640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdff801a4b0 tx=0x7fdff8019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b8670 con 0x7fe00015d7b0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff80b87d0 con 0x7fe00015d7b0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b8b80 con 0x7fe00015d7b0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000c7420 con 0x7fe00015d7b0 2023-11-24T07:57:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000ca9b0 con 0x7fe00015d7b0 2023-11-24T07:57:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.893+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000ce3d0 con 0x7fe00015d7b0 2023-11-24T07:57:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.897+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdff80b8ce0 con 0x7fe00015d7b0 2023-11-24T07:57:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.897+0000 7fdffd7fa640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 0x7fdfe4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.897+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdff811ef80 con 0x7fe00015d7b0 2023-11-24T07:57:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.897+0000 7fe004cf3640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 0x7fdfe4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.897+0000 7fe004cf3640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 0x7fdfe4068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000f70 tx=0x7fdff4007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:40.901+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0000ce3d0 con 0x7fe00015d7b0 2023-11-24T07:57:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.057+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0000ce3d0 con 0x7fe00015d7b0 2023-11-24T07:57:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fdffd7fa640 1 -- 172.21.15.5:0/1912253482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdff80bc060 con 0x7fe00015d7b0 2023-11-24T07:57:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:41.062 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-11-24T07:57:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 msgr2=0x7fdfe4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 0x7fdfe4068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000f70 tx=0x7fdff4007d50 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 msgr2=0x7fe0000b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdff801a4b0 tx=0x7fdff8019620 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 shutdown_connections 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fdfe4066470 0x7fdfe4068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe00015d7b0 0x7fe0000b83a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0000d1eb0 0x7fe0000c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 --2- 172.21.15.5:0/1912253482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0000cead0 0x7fe00015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 >> 172.21.15.5:0/1912253482 conn(0x7fe0000d33b0 msgr2=0x7fe0000b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 shutdown_connections 2023-11-24T07:57:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.061+0000 7fe006f57640 1 -- 172.21.15.5:0/1912253482 wait complete. 2023-11-24T07:57:41.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T07:57:41.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T07:57:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 Processor -- start 2023-11-24T07:57:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 -- start start 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 0x7f930c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c147190 con 0x7f930c15db40 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0b4bb0 con 0x7f930c146820 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f9313217640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c146c00 con 0x7f930c0b4210 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f93117b4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f930c15db40 0x7f930c15df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38466/0 (socket says 172.21.15.5:38466) 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f93117b4640 1 -- 172.21.15.5:0/476551146 learned_addr learned my addr 172.21.15.5:0/476551146 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930bfff640 1 --2- 172.21.15.5:0/476551146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 0x7f930c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930b7fe640 1 -- 172.21.15.5:0/476551146 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768022679 0 0) 0x7f930c147190 con 0x7f930c15db40 2023-11-24T07:57:41.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930b7fe640 1 -- 172.21.15.5:0/476551146 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc003530 con 0x7f930c15db40 2023-11-24T07:57:41.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930bfff640 1 -- 172.21.15.5:0/476551146 >> v1:172.21.15.102:6789/0 conn(0x7f930c146820 legacy=0x7f930c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930bfff640 1 -- 172.21.15.5:0/476551146 >> v1:172.21.15.5:6789/0 conn(0x7f930c15db40 legacy=0x7f930c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.229+0000 7f930bfff640 1 -- 172.21.15.5:0/476551146 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c06d030 con 0x7f930c0b4210 2023-11-24T07:57:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f930bfff640 1 --2- 172.21.15.5:0/476551146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 0x7f930c0b4670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92f80097f0 tx=0x7f92f801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7886db31d927b654 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f930b7fe640 1 -- 172.21.15.5:0/476551146 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80aa5f0 con 0x7f930c0b4210 2023-11-24T07:57:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f930b7fe640 1 -- 172.21.15.5:0/476551146 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80aa750 con 0x7f930c0b4210 2023-11-24T07:57:41.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f930b7fe640 1 -- 172.21.15.5:0/476551146 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80aaae0 con 0x7f930c0b4210 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 -- 172.21.15.5:0/476551146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 msgr2=0x7f930c0b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 --2- 172.21.15.5:0/476551146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 0x7f930c0b4670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92f80097f0 tx=0x7f92f801c490 comp rx=0 tx=0).stop 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 -- 172.21.15.5:0/476551146 shutdown_connections 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 --2- 172.21.15.5:0/476551146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c0b4210 0x7f930c0b4670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 -- 172.21.15.5:0/476551146 >> 172.21.15.5:0/476551146 conn(0x7f930c0b2f10 msgr2=0x7f930c0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 -- 172.21.15.5:0/476551146 shutdown_connections 2023-11-24T07:57:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.233+0000 7f9313217640 1 -- 172.21.15.5:0/476551146 wait complete. 2023-11-24T07:57:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 Processor -- start 2023-11-24T07:57:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 -- start start 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c146820 0x7f930c13f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c15db40 0x7f930c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c13ecc0 con 0x7f930c0b4210 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c13f280 con 0x7f930c146820 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c13dd90 con 0x7f930c15db40 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57096/0 (socket says 172.21.15.5:57096) 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 -- 172.21.15.5:0/3516005861 learned_addr learned my addr 172.21.15.5:0/3516005861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f93117b4640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c15db40 0x7f930c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f930bfff640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c146820 0x7f930c13f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 -- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c15db40 msgr2=0x7f930c15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c15db40 0x7f930c15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 -- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c146820 msgr2=0x7f930c13f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c146820 0x7f930c13f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 -- 172.21.15.5:0/3516005861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8009420 con 0x7f930c0b4210 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9310fb3640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f930000c500 tx=0x7f930000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300005220 con 0x7f930c0b4210 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300005380 con 0x7f930c0b4210 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c13e070 con 0x7f930c0b4210 2023-11-24T07:57:41.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.237+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300007270 con 0x7f930c0b4210 2023-11-24T07:57:41.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c15d190 con 0x7f930c0b4210 2023-11-24T07:57:41.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c06bb10 con 0x7f930c0b4210 2023-11-24T07:57:41.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93000073d0 con 0x7f930c0b4210 2023-11-24T07:57:41.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f93097fa640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 0x7f92f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9300083380 con 0x7f930c0b4210 2023-11-24T07:57:41.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.241+0000 7f930bfff640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 0x7f92f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.245+0000 7f930bfff640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 0x7f92f0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92f80ae000 tx=0x7f92f80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.245+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9300050b70 con 0x7f930c0b4210 2023-11-24T07:57:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.405+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f930c04e850 con 0x7f930c0b4210 2023-11-24T07:57:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.481+0000 7f93097fa640 1 -- 172.21.15.5:0/3516005861 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9300054190 con 0x7f930c0b4210 2023-11-24T07:57:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 msgr2=0x7f92f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 0x7f92f0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92f80ae000 tx=0x7f92f80a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 msgr2=0x7f930c13cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f930000c500 tx=0x7f930000c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 shutdown_connections 2023-11-24T07:57:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f92f0066470 0x7f92f0068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f930c15db40 0x7f930c15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c146820 0x7f930c13f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 --2- 172.21.15.5:0/3516005861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930c0b4210 0x7f930c13cb80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 >> 172.21.15.5:0/3516005861 conn(0x7f930c0b2f10 msgr2=0x7f930c145860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 shutdown_connections 2023-11-24T07:57:41.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.485+0000 7f9313217640 1 -- 172.21.15.5:0/3516005861 wait complete. 2023-11-24T07:57:41.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T07:57:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.657+0000 7fcbdf372640 1 Processor -- start 2023-11-24T07:57:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.657+0000 7fcbdf372640 1 -- start start 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.657+0000 7fcbdf372640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 0x7fcbd80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.657+0000 7fcbdf372640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 0x7fcbd815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.657+0000 7fcbdf372640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd8147190 con 0x7fcbd8146820 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdf372640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80b4be0 con 0x7fcbd80b4210 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdf372640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8146c00 con 0x7fcbd815db40 2023-11-24T07:57:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd10e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcbd8146820 0x7fcbd8070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38482/0 (socket says 172.21.15.5:38482) 2023-11-24T07:57:41.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd10e640 1 -- 172.21.15.5:0/1211637698 learned_addr learned my addr 172.21.15.5:0/1211637698 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 --2- 172.21.15.5:0/1211637698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 0x7fcbd815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdc90d640 1 --2- 172.21.15.5:0/1211637698 >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 0x7fcbd80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbcffff640 1 -- 172.21.15.5:0/1211637698 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550674465 0 0) 0x7fcbd8147190 con 0x7fcbd8146820 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbcffff640 1 -- 172.21.15.5:0/1211637698 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc4003530 con 0x7fcbd8146820 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 -- 172.21.15.5:0/1211637698 >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 msgr2=0x7fcbd80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 --2- 172.21.15.5:0/1211637698 >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 0x7fcbd80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 -- 172.21.15.5:0/1211637698 >> v1:172.21.15.5:6789/0 conn(0x7fcbd8146820 legacy=0x7fcbd8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 -- 172.21.15.5:0/1211637698 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd806d030 con 0x7fcbd815db40 2023-11-24T07:57:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdc90d640 1 --2- 172.21.15.5:0/1211637698 >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 0x7fcbd80b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:41.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.661+0000 7fcbdd90f640 1 --2- 172.21.15.5:0/1211637698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 0x7fcbd815df90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009d90 tx=0x7fcbd001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c5e39082a8097d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbcffff640 1 -- 172.21.15.5:0/1211637698 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00a59e0 con 0x7fcbd815db40 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbcffff640 1 -- 172.21.15.5:0/1211637698 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd00a5b40 con 0x7fcbd815db40 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbcffff640 1 -- 172.21.15.5:0/1211637698 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00ad440 con 0x7fcbd815db40 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- 172.21.15.5:0/1211637698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 msgr2=0x7fcbd815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1211637698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 0x7fcbd815df90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009d90 tx=0x7fcbd001c920 comp rx=0 tx=0).stop 2023-11-24T07:57:41.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- 172.21.15.5:0/1211637698 shutdown_connections 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1211637698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd815db40 0x7fcbd815df90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1211637698 >> v2:172.21.15.102:3300/0 conn(0x7fcbd80b4210 0x7fcbd80b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- 172.21.15.5:0/1211637698 >> 172.21.15.5:0/1211637698 conn(0x7fcbd80b2f10 msgr2=0x7fcbd80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- 172.21.15.5:0/1211637698 shutdown_connections 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- 172.21.15.5:0/1211637698 wait complete. 2023-11-24T07:57:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 Processor -- start 2023-11-24T07:57:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- start start 2023-11-24T07:57:41.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd8146820 0x7fcbd815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbd815db40 0x7fcbd813a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80d1d20 con 0x7fcbd80b4210 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80ca6c0 con 0x7fcbd815db40 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdf372640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80ca9a0 con 0x7fcbd8146820 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.665+0000 7fcbdd10e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57104/0 (socket says 172.21.15.5:57104) 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 -- 172.21.15.5:0/1341930632 learned_addr learned my addr 172.21.15.5:0/1341930632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdc90d640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd8146820 0x7fcbd815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd90f640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbd815db40 0x7fcbd813a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 -- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd8146820 msgr2=0x7fcbd815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd8146820 0x7fcbd815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 -- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbd815db40 msgr2=0x7fcbd813a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbd815db40 0x7fcbd813a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 -- 172.21.15.5:0/1341930632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009420 con 0x7fcbd80b4210 2023-11-24T07:57:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdd10e640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c450 tx=0x7fcbd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4005cf0 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4005e50 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd0009a70 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4007290 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd80cb540 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd806bb10 con 0x7fcbd80b4210 2023-11-24T07:57:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.669+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbd40073f0 con 0x7fcbd80b4210 2023-11-24T07:57:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.673+0000 7fcbcdffb640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 0x7fcbbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.673+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcbd40831e0 con 0x7fcbd80b4210 2023-11-24T07:57:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.673+0000 7fcbdc90d640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 0x7fcbbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.673+0000 7fcbdc90d640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 0x7fcbbc068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80b4bb0 tx=0x7fcbc8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.677+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbd40508e0 con 0x7fcbd80b4210 2023-11-24T07:57:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:41.837+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcbd804e850 con 0x7fcbd80b4210 2023-11-24T07:57:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.485+0000 7fcbcdffb640 1 -- 172.21.15.5:0/1341930632 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcbd40170d0 con 0x7fcbd80b4210 2023-11-24T07:57:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 msgr2=0x7fcbbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 0x7fcbbc068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80b4bb0 tx=0x7fcbc8009190 comp rx=0 tx=0).stop 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 msgr2=0x7fcbd813f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c450 tx=0x7fcbd400c910 comp rx=0 tx=0).stop 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 shutdown_connections 2023-11-24T07:57:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fcbbc066470 0x7fcbbc068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbd815db40 0x7fcbd813a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbd8146820 0x7fcbd815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 --2- 172.21.15.5:0/1341930632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd80b4210 0x7fcbd813f4f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 >> 172.21.15.5:0/1341930632 conn(0x7fcbd80b2f10 msgr2=0x7fcbd8143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 shutdown_connections 2023-11-24T07:57:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.489+0000 7fcbdf372640 1 -- 172.21.15.5:0/1341930632 wait complete. 2023-11-24T07:57:42.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T07:57:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.673+0000 7fd14c668640 1 Processor -- start 2023-11-24T07:57:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.673+0000 7fd14c668640 1 -- start start 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14c668640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd14415e690 0x7fd1440ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14c668640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440af630 con 0x7fd14406d190 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14c668640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440acb10 con 0x7fd1440b5830 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14c668640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14415eaf0 con 0x7fd14415e690 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd149c03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd14415e690 0x7fd1440ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14ac05640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd14406d190 0x7fd14406d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38492/0 (socket says 172.21.15.5:38492) 2023-11-24T07:57:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd14ac05640 1 -- 172.21.15.5:0/1802035488 learned_addr learned my addr 172.21.15.5:0/1802035488 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd149c03640 1 -- 172.21.15.5:0/1802035488 >> v1:172.21.15.102:6789/0 conn(0x7fd1440b5830 legacy=0x7fd1440acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd149c03640 1 -- 172.21.15.5:0/1802035488 >> v1:172.21.15.5:6789/0 conn(0x7fd14406d190 legacy=0x7fd14406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.677+0000 7fd149c03640 1 -- 172.21.15.5:0/1802035488 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440ae5b0 con 0x7fd14415e690 2023-11-24T07:57:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd149c03640 1 --2- 172.21.15.5:0/1802035488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14415e690 0x7fd1440ad480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097c0 tx=0x7fd13401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffd0b57bbf6c5af server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd149402640 1 -- 172.21.15.5:0/1802035488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340ab650 con 0x7fd14415e690 2023-11-24T07:57:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd149402640 1 -- 172.21.15.5:0/1802035488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1340ab7b0 con 0x7fd14415e690 2023-11-24T07:57:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd149402640 1 -- 172.21.15.5:0/1802035488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340abb40 con 0x7fd14415e690 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- 172.21.15.5:0/1802035488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14415e690 msgr2=0x7fd1440ad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 --2- 172.21.15.5:0/1802035488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14415e690 0x7fd1440ad480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097c0 tx=0x7fd13401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- 172.21.15.5:0/1802035488 shutdown_connections 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 --2- 172.21.15.5:0/1802035488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14415e690 0x7fd1440ad480 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- 172.21.15.5:0/1802035488 >> 172.21.15.5:0/1802035488 conn(0x7fd144071d80 msgr2=0x7fd14406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- 172.21.15.5:0/1802035488 shutdown_connections 2023-11-24T07:57:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- 172.21.15.5:0/1802035488 wait complete. 2023-11-24T07:57:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 Processor -- start 2023-11-24T07:57:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.681+0000 7fd14c668640 1 -- start start 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1440b5830 0x7fd14413a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 0x7fd14413b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144139820 con 0x7fd14406d190 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144139b00 con 0x7fd14415e690 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144139de0 con 0x7fd1440b5830 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57132/0 (socket says 172.21.15.5:57132) 2023-11-24T07:57:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 -- 172.21.15.5:0/2685015925 learned_addr learned my addr 172.21.15.5:0/2685015925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd149c03640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1440b5830 0x7fd14413a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14ac05640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 0x7fd14413b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 -- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1440b5830 msgr2=0x7fd14413a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1440b5830 0x7fd14413a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 -- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 msgr2=0x7fd14413b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 0x7fd14413b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 -- 172.21.15.5:0/2685015925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009420 con 0x7fd14406d190 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14ac05640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 0x7fd14413b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14a404640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c500 tx=0x7fd14000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140005220 con 0x7fd14406d190 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140005380 con 0x7fd14406d190 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140007270 con 0x7fd14406d190 2023-11-24T07:57:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14413a0c0 con 0x7fd14406d190 2023-11-24T07:57:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14413ae00 con 0x7fd14406d190 2023-11-24T07:57:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.685+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14404e850 con 0x7fd14406d190 2023-11-24T07:57:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.689+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1400073d0 con 0x7fd14406d190 2023-11-24T07:57:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.689+0000 7fd13affd640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 0x7fd128068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.689+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd1400844e0 con 0x7fd14406d190 2023-11-24T07:57:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.689+0000 7fd149c03640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 0x7fd128068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.689+0000 7fd149c03640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 0x7fd128068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd1340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:42.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.693+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd140051a50 con 0x7fd14406d190 2023-11-24T07:57:42.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:42.881+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd14413a570 con 0x7fd14406d190 2023-11-24T07:57:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.513+0000 7fd13affd640 1 -- 172.21.15.5:0/2685015925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd140055070 con 0x7fd14406d190 2023-11-24T07:57:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T07:57:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 msgr2=0x7fd128068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 0x7fd128068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd1340a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 msgr2=0x7fd144139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c500 tx=0x7fd14000c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 shutdown_connections 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd128066470 0x7fd128068930 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd1340a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd14415e690 0x7fd14413b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1440b5830 0x7fd14413a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 --2- 172.21.15.5:0/2685015925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14406d190 0x7fd144139120 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 >> 172.21.15.5:0/2685015925 conn(0x7fd144071d80 msgr2=0x7fd144160640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.521+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 shutdown_connections 2023-11-24T07:57:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.525+0000 7fd14c668640 1 -- 172.21.15.5:0/2685015925 wait complete. 2023-11-24T07:57:43.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 Processor -- start 2023-11-24T07:57:43.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 -- start start 2023-11-24T07:57:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f6244168160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440cefd0 con 0x7f624415d7b0 2023-11-24T07:57:43.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440cf2b0 con 0x7f62440cead0 2023-11-24T07:57:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624bb57640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440d17e0 con 0x7f62440d2080 2023-11-24T07:57:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f62498f3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f624415d7b0 0x7f62440d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38496/0 (socket says 172.21.15.5:38496) 2023-11-24T07:57:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f62498f3640 1 -- 172.21.15.5:0/1986883832 learned_addr learned my addr 172.21.15.5:0/1986883832 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f624a0f4640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f6244168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663523251 0 0) 0x7f62440cefd0 con 0x7f624415d7b0 2023-11-24T07:57:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.709+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6230003530 con 0x7f624415d7b0 2023-11-24T07:57:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638125573 0 0) 0x7f6230003530 con 0x7f624415d7b0 2023-11-24T07:57:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 msgr2=0x7f6244168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f6244168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 >> v1:172.21.15.102:6789/0 conn(0x7f62440cead0 legacy=0x7f62440d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624406b3f0 con 0x7f624415d7b0 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f6240001680 con 0x7f624415d7b0 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 >> v1:172.21.15.5:6789/0 conn(0x7f624415d7b0 legacy=0x7f62440d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f62300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6230003ef0 0x7f62300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6230004d10 0x7f6230005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440d17e0 con 0x7f6230003ef0 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623000bb80 con 0x7f6230004d10 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623000bd40 con 0x7f62440d2080 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62490f2640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6230003ef0 0x7f62300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f62300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f624a0f4640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6230004d10 0x7f6230005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 -- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6230004d10 msgr2=0x7f6230005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6230004d10 0x7f6230005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 -- 172.21.15.5:0/1986883832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6230003ef0 msgr2=0x7f62300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6230003ef0 0x7f62300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 -- 172.21.15.5:0/1986883832 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230003530 con 0x7f62440d2080 2023-11-24T07:57:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f624a0f4640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6230004d10 0x7f6230005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:43.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62490f2640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6230003ef0 0x7f62300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.713+0000 7f62498f3640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f62300039b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f624000c190 tx=0x7f624001cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b920b00f413e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240005ae0 con 0x7f62440d2080 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240005c40 con 0x7f62440d2080 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f62488f1640 1 -- 172.21.15.5:0/1986883832 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400a5840 con 0x7f62440d2080 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 msgr2=0x7f62300039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 --2- 172.21.15.5:0/1986883832 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62440d2080 0x7f62300039b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f624000c190 tx=0x7f624001cbf0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624a0f4640 1 -- 172.21.15.5:0/1986883832 reap_dead start 2023-11-24T07:57:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- 172.21.15.5:0/1986883832 shutdown_connections 2023-11-24T07:57:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- 172.21.15.5:0/1986883832 >> 172.21.15.5:0/1986883832 conn(0x7f62440d33b0 msgr2=0x7f62440d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- 172.21.15.5:0/1986883832 shutdown_connections 2023-11-24T07:57:43.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- 172.21.15.5:0/1986883832 wait complete. 2023-11-24T07:57:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 Processor -- start 2023-11-24T07:57:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- start start 2023-11-24T07:57:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 0x7f6244155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 0x7f6244156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440b66b0 con 0x7f62440d2080 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6244156740 con 0x7f62441444c0 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.717+0000 7f624bb57640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624415a470 con 0x7f6244144940 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57152/0 (socket says 172.21.15.5:57152) 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 -- 172.21.15.5:0/3240188489 learned_addr learned my addr 172.21.15.5:0/3240188489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62490f2640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 0x7f6244155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f624a0f4640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 0x7f6244156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 -- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 msgr2=0x7f6244156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 0x7f6244156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 -- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 msgr2=0x7f6244155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 0x7f6244155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 -- 172.21.15.5:0/3240188489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624415ae40 con 0x7f62440d2080 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62490f2640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 0x7f6244155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f624a0f4640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 0x7f6244156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f62498f3640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f624001c660 tx=0x7f6230005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400b4070 con 0x7f62440d2080 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400013c0 con 0x7f62440d2080 2023-11-24T07:57:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62440b60f0 con 0x7f62440d2080 2023-11-24T07:57:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400a5840 con 0x7f62440d2080 2023-11-24T07:57:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624415a100 con 0x7f62440d2080 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6244159f60 con 0x7f62440d2080 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.721+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62400a59a0 con 0x7f62440d2080 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.725+0000 7f623a7fc640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 0x7f6228068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.725+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f624011d950 con 0x7f62440d2080 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.725+0000 7f62490f2640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 0x7f6228068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.725+0000 7f62490f2640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 0x7f6228068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f62440b3170 tx=0x7f6234009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:43.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.729+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6244159f60 con 0x7f62440d2080 2023-11-24T07:57:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.885+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6244159f60 con 0x7f62440d2080 2023-11-24T07:57:43.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f623a7fc640 1 -- 172.21.15.5:0/3240188489 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f6244159f60 con 0x7f62440d2080 2023-11-24T07:57:43.890 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:43.891 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:42.886257+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 msgr2=0x7f6228068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 0x7f6228068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f62440b3170 tx=0x7f6234009040 comp rx=0 tx=0).stop 2023-11-24T07:57:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 msgr2=0x7f624415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f624001c660 tx=0x7f6230005800 comp rx=0 tx=0).stop 2023-11-24T07:57:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 shutdown_connections 2023-11-24T07:57:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f62280664a0 0x7f6228068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6244144940 0x7f6244156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62441444c0 0x7f6244155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 --2- 172.21.15.5:0/3240188489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62440d2080 0x7f624415a900 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 >> 172.21.15.5:0/3240188489 conn(0x7f62440d33b0 msgr2=0x7f62440d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 shutdown_connections 2023-11-24T07:57:43.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:43.889+0000 7f624bb57640 1 -- 172.21.15.5:0/3240188489 wait complete. 2023-11-24T07:57:43.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 Processor -- start 2023-11-24T07:57:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 -- start start 2023-11-24T07:57:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76b00cb230 0x7f76b0159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00b41a0 con 0x7f76b00b3320 2023-11-24T07:57:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0159dc0 con 0x7f76b00cb230 2023-11-24T07:57:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.053+0000 7f76b5bf8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b006cd40 con 0x7f76b00b3740 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76b00cb230 0x7f76b0159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76affff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76aeffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f76b00b3320 0x7f76b006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39716/0 (socket says 172.21.15.5:39716) 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f76b00cb230 0x7f76b0159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57156/0 (socket says 172.21.15.5:57156) 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76aeffd640 1 -- 172.21.15.5:0/2935142574 learned_addr learned my addr 172.21.15.5:0/2935142574 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76affff640 1 --2- 172.21.15.5:0/2935142574 >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:33554/0 (socket says 172.21.15.5:33554) 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76ae7fc640 1 -- 172.21.15.5:0/2935142574 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846221457 0 0) 0x7f76b00b41a0 con 0x7f76b00b3320 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 -- 172.21.15.5:0/2935142574 >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 msgr2=0x7f76b0070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 --2- 172.21.15.5:0/2935142574 >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 -- 172.21.15.5:0/2935142574 >> v1:172.21.15.102:6789/0 conn(0x7f76b00b3320 legacy=0x7f76b006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 -- 172.21.15.5:0/2935142574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00b3be0 con 0x7f76b00cb230 2023-11-24T07:57:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76affff640 1 --2- 172.21.15.5:0/2935142574 >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.057+0000 7f76af7fe640 1 --2- 172.21.15.5:0/2935142574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0159880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f76b00cea80 tx=0x7f76a001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca87eb1318980cba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76ae7fc640 1 -- 172.21.15.5:0/2935142574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00ab600 con 0x7f76b00cb230 2023-11-24T07:57:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76ae7fc640 1 -- 172.21.15.5:0/2935142574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a00a7050 con 0x7f76b00cb230 2023-11-24T07:57:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76ae7fc640 1 -- 172.21.15.5:0/2935142574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00ab980 con 0x7f76b00cb230 2023-11-24T07:57:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2935142574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 msgr2=0x7f76b0159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2935142574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0159880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f76b00cea80 tx=0x7f76a001c2f0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2935142574 shutdown_connections 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2935142574 >> v2:172.21.15.102:3300/0 conn(0x7f76b00b3740 0x7f76b0070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2935142574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0159880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2935142574 >> 172.21.15.5:0/2935142574 conn(0x7f76b00b0c40 msgr2=0x7f76b00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2935142574 shutdown_connections 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2935142574 wait complete. 2023-11-24T07:57:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 Processor -- start 2023-11-24T07:57:44.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- start start 2023-11-24T07:57:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76b00b3320 0x7f76b014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76b00b3740 0x7f76b0166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b014a980 con 0x7f76b00cb230 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0166240 con 0x7f76b00b3740 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76b5bf8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0158c30 con 0x7f76b00b3320 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57162/0 (socket says 172.21.15.5:57162) 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76b00b3740 0x7f76b0166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76affff640 1 -- 172.21.15.5:0/2204159825 learned_addr learned my addr 172.21.15.5:0/2204159825 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.061+0000 7f76af7fe640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76b00b3320 0x7f76b014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 -- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76b00b3320 msgr2=0x7f76b014a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76b00b3320 0x7f76b014a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 -- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76b00b3740 msgr2=0x7f76b0166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76b00b3740 0x7f76b0166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 -- 172.21.15.5:0/2204159825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009a70 con 0x7f76b00cb230 2023-11-24T07:57:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76affff640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76a800efc0 tx=0x7f76a8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8009d70 con 0x7f76b00cb230 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a800f040 con 0x7f76b00cb230 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80039a0 con 0x7f76b00cb230 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a0009420 con 0x7f76b00cb230 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b0166500 con 0x7f76b00cb230 2023-11-24T07:57:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b004e850 con 0x7f76b00cb230 2023-11-24T07:57:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76a80144a0 con 0x7f76b00cb230 2023-11-24T07:57:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.065+0000 7f7697fff640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 0x7f769c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.069+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a80849d0 con 0x7f76b00cb230 2023-11-24T07:57:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.069+0000 7f76af7fe640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 0x7f769c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.069+0000 7f76af7fe640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 0x7f769c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ad000 tx=0x7f76a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.073+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76a8051f00 con 0x7f76b00cb230 2023-11-24T07:57:44.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:57:44.084 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:57:44.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76b00b24c0 con 0x7f76b00cb230 2023-11-24T07:57:44.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f7697fff640 1 -- 172.21.15.5:0/2204159825 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f76a8018090 con 0x7f76b00cb230 2023-11-24T07:57:44.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:44.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:42.886257+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 msgr2=0x7f769c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 0x7f769c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ad000 tx=0x7f76a0008040 comp rx=0 tx=0).stop 2023-11-24T07:57:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 msgr2=0x7f76b0149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76a800efc0 tx=0x7f76a8009f90 comp rx=0 tx=0).stop 2023-11-24T07:57:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 shutdown_connections 2023-11-24T07:57:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f769c066470 0x7f769c068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b00cb230 0x7f76b0149910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76b00b3740 0x7f76b0166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 --2- 172.21.15.5:0/2204159825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76b00b3320 0x7f76b014a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 >> 172.21.15.5:0/2204159825 conn(0x7f76b00b0c40 msgr2=0x7f76b00ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 shutdown_connections 2023-11-24T07:57:44.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.237+0000 7f76b5bf8640 1 -- 172.21.15.5:0/2204159825 wait complete. 2023-11-24T07:57:44.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T07:57:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.405+0000 7eff21d0e640 1 Processor -- start 2023-11-24T07:57:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.405+0000 7eff21d0e640 1 -- start start 2023-11-24T07:57:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.405+0000 7eff21d0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 0x7eff1c1619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.405+0000 7eff21d0e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7eff1c161f20 0x7eff1c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff21d0e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c161290 con 0x7eff1c0b2870 2023-11-24T07:57:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff21d0e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0b0b80 con 0x7eff1c161f20 2023-11-24T07:57:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff21d0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c15ebc0 con 0x7eff1c0b07a0 2023-11-24T07:57:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff1c0b2870 0x7eff1c0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38510/0 (socket says 172.21.15.5:38510) 2023-11-24T07:57:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1bfff640 1 -- 172.21.15.5:0/2482161451 learned_addr learned my addr 172.21.15.5:0/2482161451 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1affd640 1 --2- 172.21.15.5:0/2482161451 >> v2:172.21.15.102:3300/0 conn(0x7eff1c161f20 0x7eff1c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1b7fe640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 0x7eff1c1619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025301914 0 0) 0x7eff1c161290 con 0x7eff1c0b2870 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff04003530 con 0x7eff1c0b2870 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547638049 0 0) 0x7eff04003530 con 0x7eff1c0b2870 2023-11-24T07:57:44.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1affd640 1 -- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 msgr2=0x7eff1c1619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1affd640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 0x7eff1c1619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1affd640 1 -- 172.21.15.5:0/2482161451 >> v1:172.21.15.5:6789/0 conn(0x7eff1c0b2870 legacy=0x7eff1c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1affd640 1 -- 172.21.15.5:0/2482161451 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c161550 con 0x7eff1c161f20 2023-11-24T07:57:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.409+0000 7eff1b7fe640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 0x7eff1c1619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff1affd640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c161f20 0x7eff1c0b0ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff100097f0 tx=0x7eff1001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84991950ac37d653 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100a4ea0 con 0x7eff1c161f20 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100a7050 con 0x7eff1c161f20 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff1a7fc640 1 -- 172.21.15.5:0/2482161451 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14001a00 con 0x7eff1c161f20 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c161f20 msgr2=0x7eff1c0b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c161f20 0x7eff1c0b0ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff100097f0 tx=0x7eff1001c3a0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- 172.21.15.5:0/2482161451 shutdown_connections 2023-11-24T07:57:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c161f20 0x7eff1c0b0ee0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 --2- 172.21.15.5:0/2482161451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b07a0 0x7eff1c1619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- 172.21.15.5:0/2482161451 >> 172.21.15.5:0/2482161451 conn(0x7eff1c0b1d50 msgr2=0x7eff1c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- 172.21.15.5:0/2482161451 shutdown_connections 2023-11-24T07:57:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- 172.21.15.5:0/2482161451 wait complete. 2023-11-24T07:57:44.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 Processor -- start 2023-11-24T07:57:44.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.413+0000 7eff21d0e640 1 -- start start 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c0b07a0 0x7eff1c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b2870 0x7eff1c155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c160600 con 0x7eff1c161f20 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c15fff0 con 0x7eff1c0b07a0 2023-11-24T07:57:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c155ea0 con 0x7eff1c0b2870 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57172/0 (socket says 172.21.15.5:57172) 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 -- 172.21.15.5:0/992029491 learned_addr learned my addr 172.21.15.5:0/992029491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1affd640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b2870 0x7eff1c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1b7fe640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c0b07a0 0x7eff1c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 -- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b2870 msgr2=0x7eff1c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b2870 0x7eff1c155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 -- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c0b07a0 msgr2=0x7eff1c15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c0b07a0 0x7eff1c15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 -- 172.21.15.5:0/992029491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009420 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff1bfff640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff14001f80 tx=0x7eff1400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012400 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14012560 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012910 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10009420 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c160290 con 0x7eff1c161f20 2023-11-24T07:57:44.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c160770 con 0x7eff1c161f20 2023-11-24T07:57:44.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.417+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff14012a70 con 0x7eff1c161f20 2023-11-24T07:57:44.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.421+0000 7eff03fff640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:44.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.421+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff14084550 con 0x7eff1c161f20 2023-11-24T07:57:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.421+0000 7eff1b7fe640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.421+0000 7eff1b7fe640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 0x7eff08068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009cf0 tx=0x7eff0c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:44.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.425+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff14051a80 con 0x7eff1c161f20 2023-11-24T07:57:44.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:44.617+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff1c04e850 con 0x7eff1c161f20 2023-11-24T07:57:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.521+0000 7eff03fff640 1 -- 172.21.15.5:0/992029491 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff140550a0 con 0x7eff1c161f20 2023-11-24T07:57:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 msgr2=0x7eff08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 0x7eff08068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009cf0 tx=0x7eff0c009190 comp rx=0 tx=0).stop 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 msgr2=0x7eff1c160a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff14001f80 tx=0x7eff1400a430 comp rx=0 tx=0).stop 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 shutdown_connections 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c161f20 0x7eff1c160a90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff1c0b2870 0x7eff1c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 --2- 172.21.15.5:0/992029491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1c0b07a0 0x7eff1c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 >> 172.21.15.5:0/992029491 conn(0x7eff1c0b1d50 msgr2=0x7eff1c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 shutdown_connections 2023-11-24T07:57:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.525+0000 7eff21d0e640 1 -- 172.21.15.5:0/992029491 wait complete. 2023-11-24T07:57:45.552 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T07:57:45.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T07:57:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.701+0000 7f2f5fa9c640 1 Processor -- start 2023-11-24T07:57:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.701+0000 7f2f5fa9c640 1 -- start start 2023-11-24T07:57:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5fa9c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f580b3c60 0x7f2f580b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5fa9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 0x7f2f580ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5fa9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580b2590 con 0x7f2f58162190 2023-11-24T07:57:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5fa9c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f580b2870 con 0x7f2f580b3c60 2023-11-24T07:57:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5fa9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580b2b50 con 0x7f2f580b4040 2023-11-24T07:57:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d037640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 0x7f2f580ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d838640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f580b3c60 0x7f2f580b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5e039640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2f58162190 0x7f2f58165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:39722/0 (socket says 172.21.15.5:39722) 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5e039640 1 -- 172.21.15.5:0/288091080 learned_addr learned my addr 172.21.15.5:0/288091080 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d838640 1 -- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 msgr2=0x7f2f580ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d838640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 0x7f2f580ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d838640 1 -- 172.21.15.5:0/288091080 >> v1:172.21.15.102:6789/0 conn(0x7f2f58162190 legacy=0x7f2f58165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d838640 1 -- 172.21.15.5:0/288091080 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580b2e30 con 0x7f2f580b3c60 2023-11-24T07:57:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.705+0000 7f2f5d037640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 0x7f2f580ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5d838640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f580b3c60 0x7f2f580b1fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097c0 tx=0x7f2f5401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9517cb0a45f1763 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5c836640 1 -- 172.21.15.5:0/288091080 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540ac640 con 0x7f2f580b3c60 2023-11-24T07:57:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5c836640 1 -- 172.21.15.5:0/288091080 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f540ac7a0 con 0x7f2f580b3c60 2023-11-24T07:57:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5c836640 1 -- 172.21.15.5:0/288091080 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540acb30 con 0x7f2f580b3c60 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f580b3c60 msgr2=0x7f2f580b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f580b3c60 0x7f2f580b1fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097c0 tx=0x7f2f5401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/288091080 shutdown_connections 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f580b4040 0x7f2f580ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/288091080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f580b3c60 0x7f2f580b1fb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/288091080 >> 172.21.15.5:0/288091080 conn(0x7f2f580b0cb0 msgr2=0x7f2f580b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/288091080 shutdown_connections 2023-11-24T07:57:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/288091080 wait complete. 2023-11-24T07:57:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 Processor -- start 2023-11-24T07:57:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.709+0000 7f2f5fa9c640 1 -- start start 2023-11-24T07:57:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f58162190 0x7f2f58144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f58144aa0 0x7f2f580717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58144f50 con 0x7f2f580b3c60 2023-11-24T07:57:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581424d0 con 0x7f2f58162190 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58142250 con 0x7f2f58144aa0 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57174/0 (socket says 172.21.15.5:57174) 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 -- 172.21.15.5:0/2189967535 learned_addr learned my addr 172.21.15.5:0/2189967535 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5e039640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f58144aa0 0x7f2f580717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d037640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f58162190 0x7f2f58144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 -- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f58144aa0 msgr2=0x7f2f580717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f58144aa0 0x7f2f580717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 -- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f58162190 msgr2=0x7f2f58144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f58162190 0x7f2f58144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 -- 172.21.15.5:0/2189967535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009420 con 0x7f2f580b3c60 2023-11-24T07:57:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5d838640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f540af040 tx=0x7f2f5401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540b8650 con 0x7f2f580b3c60 2023-11-24T07:57:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f540b87b0 con 0x7f2f580b3c60 2023-11-24T07:57:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540b8b40 con 0x7f2f580b3c60 2023-11-24T07:57:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f54009420 con 0x7f2f580b3c60 2023-11-24T07:57:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f580726e0 con 0x7f2f580b3c60 2023-11-24T07:57:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.713+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f580671f0 con 0x7f2f580b3c60 2023-11-24T07:57:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.717+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f540b8ca0 con 0x7f2f580b3c60 2023-11-24T07:57:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.717+0000 7f2f4e7fc640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 0x7f2f3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.717+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f5411e9f0 con 0x7f2f580b3c60 2023-11-24T07:57:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.717+0000 7f2f5d037640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 0x7f2f3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.717+0000 7f2f5d037640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 0x7f2f3c068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f5815c1c0 tx=0x7f2f48009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.721+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f540ebfa0 con 0x7f2f580b3c60 2023-11-24T07:57:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:45.913+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2f5815b9f0 con 0x7f2f580b3c60 2023-11-24T07:57:46.477 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-11-24T07:57:46.477+0000 7f05778ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T07:57:46.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f4e7fc640 1 -- 172.21.15.5:0/2189967535 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f540b1020 con 0x7f2f580b3c60 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 msgr2=0x7f2f3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 0x7f2f3c068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f5815c1c0 tx=0x7f2f48009190 comp rx=0 tx=0).stop 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 msgr2=0x7f2f58141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f540af040 tx=0x7f2f5401ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 shutdown_connections 2023-11-24T07:57:46.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2f3c066470 0x7f2f3c068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f58144aa0 0x7f2f580717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f58162190 0x7f2f58144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 --2- 172.21.15.5:0/2189967535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f580b3c60 0x7f2f58141d10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 >> 172.21.15.5:0/2189967535 conn(0x7f2f580b0cb0 msgr2=0x7f2f580b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 shutdown_connections 2023-11-24T07:57:46.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.525+0000 7f2f5fa9c640 1 -- 172.21.15.5:0/2189967535 wait complete. 2023-11-24T07:57:46.551 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T07:57:46.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:46.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 Processor -- start 2023-11-24T07:57:46.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 -- start start 2023-11-24T07:57:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fceb80ae3d0 0x7fceb806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80ae7f0 con 0x7fceb8143ae0 2023-11-24T07:57:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb806e980 con 0x7fceb806dfd0 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fcebc89a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8070670 con 0x7fceb80ae3d0 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fceb80ae3d0 0x7fceb806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fceb8143ae0 0x7fceb80b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38526/0 (socket says 172.21.15.5:38526) 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb659c640 1 -- 172.21.15.5:0/1782703606 learned_addr learned my addr 172.21.15.5:0/1782703606 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb6d9d640 1 -- 172.21.15.5:0/1782703606 >> v1:172.21.15.102:6789/0 conn(0x7fceb806dfd0 legacy=0x7fceb80adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb6d9d640 1 -- 172.21.15.5:0/1782703606 >> v1:172.21.15.5:6789/0 conn(0x7fceb8143ae0 legacy=0x7fceb80b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb6d9d640 1 -- 172.21.15.5:0/1782703606 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8070950 con 0x7fceb80ae3d0 2023-11-24T07:57:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.697+0000 7fceb559a640 1 -- 172.21.15.5:0/1782703606 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592532594 0 0) 0x7fceb80ae7f0 con 0x7fceb8143ae0 2023-11-24T07:57:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fceb6d9d640 1 --2- 172.21.15.5:0/1782703606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb806e440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009d90 tx=0x7fceb001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a668540afd2ca410 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fceb559a640 1 -- 172.21.15.5:0/1782703606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00a59e0 con 0x7fceb80ae3d0 2023-11-24T07:57:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fceb559a640 1 -- 172.21.15.5:0/1782703606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb00a5b40 con 0x7fceb80ae3d0 2023-11-24T07:57:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fceb559a640 1 -- 172.21.15.5:0/1782703606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00ad440 con 0x7fceb80ae3d0 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 -- 172.21.15.5:0/1782703606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 msgr2=0x7fceb806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 --2- 172.21.15.5:0/1782703606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb806e440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009d90 tx=0x7fceb001c920 comp rx=0 tx=0).stop 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 -- 172.21.15.5:0/1782703606 shutdown_connections 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 --2- 172.21.15.5:0/1782703606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb806e440 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 -- 172.21.15.5:0/1782703606 >> 172.21.15.5:0/1782703606 conn(0x7fceb80b0c40 msgr2=0x7fceb80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 -- 172.21.15.5:0/1782703606 shutdown_connections 2023-11-24T07:57:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.701+0000 7fcebc89a640 1 -- 172.21.15.5:0/1782703606 wait complete. 2023-11-24T07:57:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 Processor -- start 2023-11-24T07:57:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- start start 2023-11-24T07:57:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceb806dfd0 0x7fceb8137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceb8143ae0 0x7fceb8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8137b00 con 0x7fceb80ae3d0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb815d000 con 0x7fceb806dfd0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8137160 con 0x7fceb8143ae0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57196/0 (socket says 172.21.15.5:57196) 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 -- 172.21.15.5:0/2793103808 learned_addr learned my addr 172.21.15.5:0/2793103808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb659c640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceb806dfd0 0x7fceb8137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb6d9d640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceb8143ae0 0x7fceb8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 -- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceb8143ae0 msgr2=0x7fceb8158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceb8143ae0 0x7fceb8158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 -- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceb806dfd0 msgr2=0x7fceb8137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceb806dfd0 0x7fceb8137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 -- 172.21.15.5:0/2793103808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009a70 con 0x7fceb80ae3d0 2023-11-24T07:57:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fceb5d9b640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c500 tx=0x7fceac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac005220 con 0x7fceb80ae3d0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac005380 con 0x7fceb80ae3d0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac007270 con 0x7fceb80ae3d0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8137440 con 0x7fceb80ae3d0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.705+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb80afdb0 con 0x7fceb80ae3d0 2023-11-24T07:57:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb804e850 con 0x7fceb80ae3d0 2023-11-24T07:57:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fceac0073d0 con 0x7fceb80ae3d0 2023-11-24T07:57:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fcea6ffd640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 0x7fce98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceac0836d0 con 0x7fceb80ae3d0 2023-11-24T07:57:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fceb659c640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 0x7fce98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.709+0000 7fceb659c640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 0x7fce98068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f70 tx=0x7fcea8007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.713+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fceac050b70 con 0x7fceb80ae3d0 2023-11-24T07:57:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.901+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fceb806cc40 con 0x7fceb80ae3d0 2023-11-24T07:57:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.901+0000 7fcea6ffd640 1 -- 172.21.15.5:0/2793103808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fceac054190 con 0x7fceb80ae3d0 2023-11-24T07:57:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:46.905 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:57:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2023-11-24T07:57:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 msgr2=0x7fce98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 0x7fce98068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f70 tx=0x7fcea8007240 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 msgr2=0x7fceb80af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c500 tx=0x7fceac00c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 shutdown_connections 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fce98066470 0x7fce98068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceb8143ae0 0x7fceb8158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb80ae3d0 0x7fceb80af870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 --2- 172.21.15.5:0/2793103808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceb806dfd0 0x7fceb8137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 >> 172.21.15.5:0/2793103808 conn(0x7fceb80b0c40 msgr2=0x7fceb80b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 shutdown_connections 2023-11-24T07:57:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:46.905+0000 7fcebc89a640 1 -- 172.21.15.5:0/2793103808 wait complete. 2023-11-24T07:57:46.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:47.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.065+0000 7fbc0289c640 1 Processor -- start 2023-11-24T07:57:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.065+0000 7fbc0289c640 1 -- start start 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc0289c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 0x7fbbfc0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc0289c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbfc06dfd0 0x7fbbfc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc0289c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc06e980 con 0x7fbbfc0adcc0 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc0289c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0ae7f0 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc0289c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b2480 con 0x7fbbfc143ae0 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc00e39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbbfc0adcc0 0x7fbbfc0ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38538/0 (socket says 172.21.15.5:38538) 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbfc06dfd0 0x7fbbfc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbc00e39640 1 -- 172.21.15.5:0/4046942288 learned_addr learned my addr 172.21.15.5:0/4046942288 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/4046942288 >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 0x7fbbfc0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfaffd640 1 -- 172.21.15.5:0/4046942288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821161178 0 0) 0x7fbbfc06e980 con 0x7fbbfc0adcc0 2023-11-24T07:57:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfaffd640 1 -- 172.21.15.5:0/4046942288 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003530 con 0x7fbbfc0adcc0 2023-11-24T07:57:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfb7fe640 1 -- 172.21.15.5:0/4046942288 >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 msgr2=0x7fbbfc0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfb7fe640 1 --2- 172.21.15.5:0/4046942288 >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 0x7fbbfc0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfb7fe640 1 -- 172.21.15.5:0/4046942288 >> v1:172.21.15.5:6789/0 conn(0x7fbbfc0adcc0 legacy=0x7fbbfc0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfb7fe640 1 -- 172.21.15.5:0/4046942288 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc070670 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.069+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/4046942288 >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 0x7fbbfc0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbbfb7fe640 1 --2- 172.21.15.5:0/4046942288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc06e440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc070080 tx=0x7fbbf001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6b9be7e7e379ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbbfaffd640 1 -- 172.21.15.5:0/4046942288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00a7070 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbbfaffd640 1 -- 172.21.15.5:0/4046942288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf00ab430 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbbfaffd640 1 -- 172.21.15.5:0/4046942288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00ab7a0 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- 172.21.15.5:0/4046942288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc06dfd0 msgr2=0x7fbbfc06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 --2- 172.21.15.5:0/4046942288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc06e440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc070080 tx=0x7fbbf001c430 comp rx=0 tx=0).stop 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- 172.21.15.5:0/4046942288 shutdown_connections 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 --2- 172.21.15.5:0/4046942288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc06e440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 --2- 172.21.15.5:0/4046942288 >> v2:172.21.15.102:3300/0 conn(0x7fbbfc143ae0 0x7fbbfc0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- 172.21.15.5:0/4046942288 >> 172.21.15.5:0/4046942288 conn(0x7fbbfc0b0c40 msgr2=0x7fbbfc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- 172.21.15.5:0/4046942288 shutdown_connections 2023-11-24T07:57:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- 172.21.15.5:0/4046942288 wait complete. 2023-11-24T07:57:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 Processor -- start 2023-11-24T07:57:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.073+0000 7fbc0289c640 1 -- start start 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 0x7fbbfc157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc158db0 con 0x7fbbfc143ae0 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc158230 con 0x7fbbfc06dfd0 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc158510 con 0x7fbbfc0adcc0 2023-11-24T07:57:47.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57204/0 (socket says 172.21.15.5:57204) 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 -- 172.21.15.5:0/320855989 learned_addr learned my addr 172.21.15.5:0/320855989 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbfb7fe640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 0x7fbbfc157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 -- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 msgr2=0x7fbbfc157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 0x7fbbfc157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 -- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 msgr2=0x7fbbfc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 -- 172.21.15.5:0/320855989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0009420 con 0x7fbbfc143ae0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbfb7fe640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 0x7fbbfc157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc00e39640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400cb40 tx=0x7fbbf400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400aca0 con 0x7fbbfc143ae0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400ae00 con 0x7fbbfc143ae0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4012620 con 0x7fbbfc143ae0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc1587f0 con 0x7fbbfc143ae0 2023-11-24T07:57:47.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc157f40 con 0x7fbbfc143ae0 2023-11-24T07:57:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc04e850 con 0x7fbbfc143ae0 2023-11-24T07:57:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.077+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbf4007070 con 0x7fbbfc143ae0 2023-11-24T07:57:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.081+0000 7fbbf8ff9640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 0x7fbbe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.081+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbf4083fa0 con 0x7fbbfc143ae0 2023-11-24T07:57:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.081+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 0x7fbbe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.081+0000 7fbbfbfff640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 0x7fbbe8068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097a0 tx=0x7fbbec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.081+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbf4051380 con 0x7fbbfc143ae0 2023-11-24T07:57:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.241+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbfc0b3d30 con 0x7fbbfc143ae0 2023-11-24T07:57:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.241+0000 7fbbf8ff9640 1 -- 172.21.15.5:0/320855989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fbbf4017090 con 0x7fbbfc143ae0 2023-11-24T07:57:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:47.246 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 msgr2=0x7fbbe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 0x7fbbe8068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097a0 tx=0x7fbbec008040 comp rx=0 tx=0).stop 2023-11-24T07:57:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 msgr2=0x7fbbfc13a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400cb40 tx=0x7fbbf400a060 comp rx=0 tx=0).stop 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 shutdown_connections 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbbe8066470 0x7fbbe8068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbfc143ae0 0x7fbbfc13a1e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbfc0adcc0 0x7fbbfc157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 --2- 172.21.15.5:0/320855989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc06dfd0 0x7fbbfc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 >> 172.21.15.5:0/320855989 conn(0x7fbbfc0b0c40 msgr2=0x7fbbfc0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 shutdown_connections 2023-11-24T07:57:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.245+0000 7fbc0289c640 1 -- 172.21.15.5:0/320855989 wait complete. 2023-11-24T07:57:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T07:57:47.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:57:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 Processor -- start 2023-11-24T07:57:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 -- start start 2023-11-24T07:57:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80f00ae3d0 0x7f80f006e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00ae7f0 con 0x7f80f006dfd0 2023-11-24T07:57:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f006e980 con 0x7f80f0143ae0 2023-11-24T07:57:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80f5d1c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f0070670 con 0x7f80f00ae3d0 2023-11-24T07:57:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80eeffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80f006dfd0 0x7f80f00adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42316/0 (socket says 172.21.15.5:42316) 2023-11-24T07:57:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80f00ae3d0 0x7f80f006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80eeffd640 1 -- 172.21.15.5:0/192659893 learned_addr learned my addr 172.21.15.5:0/192659893 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80effff640 1 -- 172.21.15.5:0/192659893 >> v1:172.21.15.102:6789/0 conn(0x7f80f0143ae0 legacy=0x7f80f00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80effff640 1 -- 172.21.15.5:0/192659893 >> v1:172.21.15.5:6789/0 conn(0x7f80f006dfd0 legacy=0x7f80f00adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80effff640 1 -- 172.21.15.5:0/192659893 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0070950 con 0x7f80f00ae3d0 2023-11-24T07:57:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.409+0000 7f80ee7fc640 1 -- 172.21.15.5:0/192659893 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736812192 0 0) 0x7f80f00ae7f0 con 0x7f80f006dfd0 2023-11-24T07:57:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80effff640 1 --2- 172.21.15.5:0/192659893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f00ae3d0 0x7f80f006e440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db72de16b6dd693d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80ee7fc640 1 -- 172.21.15.5:0/192659893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80a59e0 con 0x7f80f00ae3d0 2023-11-24T07:57:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80ee7fc640 1 -- 172.21.15.5:0/192659893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80a5b40 con 0x7f80f00ae3d0 2023-11-24T07:57:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80ee7fc640 1 -- 172.21.15.5:0/192659893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80ad440 con 0x7f80f00ae3d0 2023-11-24T07:57:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 -- 172.21.15.5:0/192659893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f00ae3d0 msgr2=0x7f80f006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/192659893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f00ae3d0 0x7f80f006e440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e801c920 comp rx=0 tx=0).stop 2023-11-24T07:57:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 -- 172.21.15.5:0/192659893 shutdown_connections 2023-11-24T07:57:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/192659893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f00ae3d0 0x7f80f006e440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 -- 172.21.15.5:0/192659893 >> 172.21.15.5:0/192659893 conn(0x7f80f00b0c40 msgr2=0x7f80f00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 -- 172.21.15.5:0/192659893 shutdown_connections 2023-11-24T07:57:47.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.413+0000 7f80f5d1c640 1 -- 172.21.15.5:0/192659893 wait complete. 2023-11-24T07:57:47.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 Processor -- start 2023-11-24T07:57:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 -- start start 2023-11-24T07:57:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80f00ae3d0 0x7f80f013dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f0143ae0 0x7f80f0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0099bf0 con 0x7f80f006dfd0 2023-11-24T07:57:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0157d80 con 0x7f80f0143ae0 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0156fa0 con 0x7f80f00ae3d0 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52858/0 (socket says 172.21.15.5:52858) 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 -- 172.21.15.5:0/3798297945 learned_addr learned my addr 172.21.15.5:0/3798297945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80eeffd640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80f00ae3d0 0x7f80f013dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80effff640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f0143ae0 0x7f80f0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 -- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80f00ae3d0 msgr2=0x7f80f013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80f00ae3d0 0x7f80f013dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 -- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f0143ae0 msgr2=0x7f80f0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f0143ae0 0x7f80f0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 -- 172.21.15.5:0/3798297945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009a70 con 0x7f80f006dfd0 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80ef7fe640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c3c0 tx=0x7f80e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00052d0 con 0x7f80f006dfd0 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0005430 con 0x7f80f006dfd0 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0003840 con 0x7f80f006dfd0 2023-11-24T07:57:47.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.417+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f0157280 con 0x7f80f006dfd0 2023-11-24T07:57:47.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f013e200 con 0x7f80f006dfd0 2023-11-24T07:57:47.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f004e850 con 0x7f80f006dfd0 2023-11-24T07:57:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80e00039a0 con 0x7f80f006dfd0 2023-11-24T07:57:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80d7fff640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 0x7f80dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80e00833b0 con 0x7f80f006dfd0 2023-11-24T07:57:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80eeffd640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 0x7f80dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.421+0000 7f80eeffd640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 0x7f80dc068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f80f006c880 tx=0x7f80e4007ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.425+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80e0050820 con 0x7f80f006dfd0 2023-11-24T07:57:47.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.585+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80f0143ec0 con 0x7f80dc066470 2023-11-24T07:57:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.597+0000 7f80d7fff640 1 -- 172.21.15.5:0/3798297945 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288891 (secure 0 0 0) 0x7f80e4007170 con 0x7f80dc066470 2023-11-24T07:57:47.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:57:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.597+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 msgr2=0x7f80dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.597+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 0x7f80dc068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f80f006c880 tx=0x7f80e4007ba0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.597+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 msgr2=0x7f80f0157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.597+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c3c0 tx=0x7f80e000c880 comp rx=0 tx=0).stop 2023-11-24T07:57:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 shutdown_connections 2023-11-24T07:57:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f80dc066470 0x7f80dc068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f0143ae0 0x7f80f0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80f00ae3d0 0x7f80f013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 --2- 172.21.15.5:0/3798297945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80f006dfd0 0x7f80f0157840 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 >> 172.21.15.5:0/3798297945 conn(0x7f80f00b0c40 msgr2=0x7f80f00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 shutdown_connections 2023-11-24T07:57:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.601+0000 7f80f5d1c640 1 -- 172.21.15.5:0/3798297945 wait complete. 2023-11-24T07:57:47.620 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-24T07:57:47.248151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237000,"kb_used_data":4180,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737720,"statfs":{"total":773094113280,"available":772851425280,"internally_reserved":0,"allocated":4280320,"data_stored":2377772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762546"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506237+0000","last_change":"2023-11-24T07:57:43.530181+0000","last_active":"2023-11-24T07:57:44.506237+0000","last_peered":"2023-11-24T07:57:44.506237+0000","last_clean":"2023-11-24T07:57:44.506237+0000","last_became_active":"2023-11-24T07:57:43.529754+0000","last_became_peered":"2023-11-24T07:57:43.529754+0000","last_unstale":"2023-11-24T07:57:44.506237+0000","last_undegraded":"2023-11-24T07:57:44.506237+0000","last_fullsized":"2023-11-24T07:57:44.506237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506352+0000","last_change":"2023-11-24T07:57:43.529706+0000","last_active":"2023-11-24T07:57:44.506352+0000","last_peered":"2023-11-24T07:57:44.506352+0000","last_clean":"2023-11-24T07:57:44.506352+0000","last_became_active":"2023-11-24T07:57:43.529246+0000","last_became_peered":"2023-11-24T07:57:43.529246+0000","last_unstale":"2023-11-24T07:57:44.506352+0000","last_undegraded":"2023-11-24T07:57:44.506352+0000","last_fullsized":"2023-11-24T07:57:44.506352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:01:56.947543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.528863+0000","last_change":"2023-11-24T07:57:43.521224+0000","last_active":"2023-11-24T07:57:43.528863+0000","last_peered":"2023-11-24T07:57:43.528863+0000","last_clean":"2023-11-24T07:57:43.528863+0000","last_became_active":"2023-11-24T07:57:43.520946+0000","last_became_peered":"2023-11-24T07:57:43.520946+0000","last_unstale":"2023-11-24T07:57:43.528863+0000","last_undegraded":"2023-11-24T07:57:43.528863+0000","last_fullsized":"2023-11-24T07:57:43.528863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559338+0000","last_change":"2023-11-24T07:57:43.521943+0000","last_active":"2023-11-24T07:57:44.559338+0000","last_peered":"2023-11-24T07:57:44.559338+0000","last_clean":"2023-11-24T07:57:44.559338+0000","last_became_active":"2023-11-24T07:57:43.521655+0000","last_became_peered":"2023-11-24T07:57:43.521655+0000","last_unstale":"2023-11-24T07:57:44.559338+0000","last_undegraded":"2023-11-24T07:57:44.559338+0000","last_fullsized":"2023-11-24T07:57:44.559338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:16.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.527516+0000","last_change":"2023-11-24T07:57:43.525661+0000","last_active":"2023-11-24T07:57:43.527516+0000","last_peered":"2023-11-24T07:57:43.527516+0000","last_clean":"2023-11-24T07:57:43.527516+0000","last_became_active":"2023-11-24T07:57:43.525384+0000","last_became_peered":"2023-11-24T07:57:43.525384+0000","last_unstale":"2023-11-24T07:57:43.527516+0000","last_undegraded":"2023-11-24T07:57:43.527516+0000","last_fullsized":"2023-11-24T07:57:43.527516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:05:45.177486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505752+0000","last_change":"2023-11-24T07:57:43.530071+0000","last_active":"2023-11-24T07:57:44.505752+0000","last_peered":"2023-11-24T07:57:44.505752+0000","last_clean":"2023-11-24T07:57:44.505752+0000","last_became_active":"2023-11-24T07:57:43.529547+0000","last_became_peered":"2023-11-24T07:57:43.529547+0000","last_unstale":"2023-11-24T07:57:44.505752+0000","last_undegraded":"2023-11-24T07:57:44.505752+0000","last_fullsized":"2023-11-24T07:57:44.505752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.548283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507059+0000","last_change":"2023-11-24T07:57:43.532405+0000","last_active":"2023-11-24T07:57:44.507059+0000","last_peered":"2023-11-24T07:57:44.507059+0000","last_clean":"2023-11-24T07:57:44.507059+0000","last_became_active":"2023-11-24T07:57:43.531577+0000","last_became_peered":"2023-11-24T07:57:43.531577+0000","last_unstale":"2023-11-24T07:57:44.507059+0000","last_undegraded":"2023-11-24T07:57:44.507059+0000","last_fullsized":"2023-11-24T07:57:44.507059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:26:55.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506315+0000","last_change":"2023-11-24T07:57:43.531282+0000","last_active":"2023-11-24T07:57:44.506315+0000","last_peered":"2023-11-24T07:57:44.506315+0000","last_clean":"2023-11-24T07:57:44.506315+0000","last_became_active":"2023-11-24T07:57:43.530566+0000","last_became_peered":"2023-11-24T07:57:43.530566+0000","last_unstale":"2023-11-24T07:57:44.506315+0000","last_undegraded":"2023-11-24T07:57:44.506315+0000","last_fullsized":"2023-11-24T07:57:44.506315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:44.407695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.521725+0000","last_change":"2023-11-24T07:57:43.514679+0000","last_active":"2023-11-24T07:57:43.521725+0000","last_peered":"2023-11-24T07:57:43.521725+0000","last_clean":"2023-11-24T07:57:43.521725+0000","last_became_active":"2023-11-24T07:57:43.514386+0000","last_became_peered":"2023-11-24T07:57:43.514386+0000","last_unstale":"2023-11-24T07:57:43.521725+0000","last_undegraded":"2023-11-24T07:57:43.521725+0000","last_fullsized":"2023-11-24T07:57:43.521725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:52.603918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559439+0000","last_change":"2023-11-24T07:57:43.531435+0000","last_active":"2023-11-24T07:57:44.559439+0000","last_peered":"2023-11-24T07:57:44.559439+0000","last_clean":"2023-11-24T07:57:44.559439+0000","last_became_active":"2023-11-24T07:57:43.531088+0000","last_became_peered":"2023-11-24T07:57:43.531088+0000","last_unstale":"2023-11-24T07:57:44.559439+0000","last_undegraded":"2023-11-24T07:57:44.559439+0000","last_fullsized":"2023-11-24T07:57:44.559439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:44.407695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506944+0000","last_change":"2023-11-24T07:57:43.532524+0000","last_active":"2023-11-24T07:57:44.506944+0000","last_peered":"2023-11-24T07:57:44.506944+0000","last_clean":"2023-11-24T07:57:44.506944+0000","last_became_active":"2023-11-24T07:57:43.532129+0000","last_became_peered":"2023-11-24T07:57:43.532129+0000","last_unstale":"2023-11-24T07:57:44.506944+0000","last_undegraded":"2023-11-24T07:57:44.506944+0000","last_fullsized":"2023-11-24T07:57:44.506944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:31.057524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.535679+0000","last_change":"2023-11-24T07:57:43.532647+0000","last_active":"2023-11-24T07:57:43.535679+0000","last_peered":"2023-11-24T07:57:43.535679+0000","last_clean":"2023-11-24T07:57:43.535679+0000","last_became_active":"2023-11-24T07:57:43.531658+0000","last_became_peered":"2023-11-24T07:57:43.531658+0000","last_unstale":"2023-11-24T07:57:43.535679+0000","last_undegraded":"2023-11-24T07:57:43.535679+0000","last_fullsized":"2023-11-24T07:57:43.535679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:39.205186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.521249+0000","last_change":"2023-11-24T07:57:43.513249+0000","last_active":"2023-11-24T07:57:43.521249+0000","last_peered":"2023-11-24T07:57:43.521249+0000","last_clean":"2023-11-24T07:57:43.521249+0000","last_became_active":"2023-11-24T07:57:43.512928+0000","last_became_peered":"2023-11-24T07:57:43.512928+0000","last_unstale":"2023-11-24T07:57:43.521249+0000","last_undegraded":"2023-11-24T07:57:43.521249+0000","last_fullsized":"2023-11-24T07:57:43.521249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:37.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505814+0000","last_change":"2023-11-24T07:57:43.529829+0000","last_active":"2023-11-24T07:57:44.505814+0000","last_peered":"2023-11-24T07:57:44.505814+0000","last_clean":"2023-11-24T07:57:44.505814+0000","last_became_active":"2023-11-24T07:57:43.529196+0000","last_became_peered":"2023-11-24T07:57:43.529196+0000","last_unstale":"2023-11-24T07:57:44.505814+0000","last_undegraded":"2023-11-24T07:57:44.505814+0000","last_fullsized":"2023-11-24T07:57:44.505814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:25.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.529124+0000","last_change":"2023-11-24T07:57:43.522711+0000","last_active":"2023-11-24T07:57:43.529124+0000","last_peered":"2023-11-24T07:57:43.529124+0000","last_clean":"2023-11-24T07:57:43.529124+0000","last_became_active":"2023-11-24T07:57:43.522410+0000","last_became_peered":"2023-11-24T07:57:43.522410+0000","last_unstale":"2023-11-24T07:57:43.529124+0000","last_undegraded":"2023-11-24T07:57:43.529124+0000","last_fullsized":"2023-11-24T07:57:43.529124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:26.414972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506596+0000","last_change":"2023-11-24T07:57:43.533557+0000","last_active":"2023-11-24T07:57:44.506596+0000","last_peered":"2023-11-24T07:57:44.506596+0000","last_clean":"2023-11-24T07:57:44.506596+0000","last_became_active":"2023-11-24T07:57:43.533228+0000","last_became_peered":"2023-11-24T07:57:43.533228+0000","last_unstale":"2023-11-24T07:57:44.506596+0000","last_undegraded":"2023-11-24T07:57:44.506596+0000","last_fullsized":"2023-11-24T07:57:44.506596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:33.328342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507290+0000","last_change":"2023-11-24T07:57:43.532469+0000","last_active":"2023-11-24T07:57:44.507290+0000","last_peered":"2023-11-24T07:57:44.507290+0000","last_clean":"2023-11-24T07:57:44.507290+0000","last_became_active":"2023-11-24T07:57:43.531595+0000","last_became_peered":"2023-11-24T07:57:43.531595+0000","last_unstale":"2023-11-24T07:57:44.507290+0000","last_undegraded":"2023-11-24T07:57:44.507290+0000","last_fullsized":"2023-11-24T07:57:44.507290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:25.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506353+0000","last_change":"2023-11-24T07:57:43.529030+0000","last_active":"2023-11-24T07:57:44.506353+0000","last_peered":"2023-11-24T07:57:44.506353+0000","last_clean":"2023-11-24T07:57:44.506353+0000","last_became_active":"2023-11-24T07:57:43.528649+0000","last_became_peered":"2023-11-24T07:57:43.528649+0000","last_unstale":"2023-11-24T07:57:44.506353+0000","last_undegraded":"2023-11-24T07:57:44.506353+0000","last_fullsized":"2023-11-24T07:57:44.506353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:42.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506102+0000","last_change":"2023-11-24T07:57:43.531416+0000","last_active":"2023-11-24T07:57:44.506102+0000","last_peered":"2023-11-24T07:57:44.506102+0000","last_clean":"2023-11-24T07:57:44.506102+0000","last_became_active":"2023-11-24T07:57:43.531158+0000","last_became_peered":"2023-11-24T07:57:43.531158+0000","last_unstale":"2023-11-24T07:57:44.506102+0000","last_undegraded":"2023-11-24T07:57:44.506102+0000","last_fullsized":"2023-11-24T07:57:44.506102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:35.428721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525075+0000","last_change":"2023-11-24T07:57:43.523319+0000","last_active":"2023-11-24T07:57:43.525075+0000","last_peered":"2023-11-24T07:57:43.525075+0000","last_clean":"2023-11-24T07:57:43.525075+0000","last_became_active":"2023-11-24T07:57:43.522923+0000","last_became_peered":"2023-11-24T07:57:43.522923+0000","last_unstale":"2023-11-24T07:57:43.525075+0000","last_undegraded":"2023-11-24T07:57:43.525075+0000","last_fullsized":"2023-11-24T07:57:43.525075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:40.653639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523925+0000","last_change":"2023-11-24T07:57:43.519091+0000","last_active":"2023-11-24T07:57:43.523925+0000","last_peered":"2023-11-24T07:57:43.523925+0000","last_clean":"2023-11-24T07:57:43.523925+0000","last_became_active":"2023-11-24T07:57:43.517936+0000","last_became_peered":"2023-11-24T07:57:43.517936+0000","last_unstale":"2023-11-24T07:57:43.523925+0000","last_undegraded":"2023-11-24T07:57:43.523925+0000","last_fullsized":"2023-11-24T07:57:43.523925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:19:14.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.540616+0000","last_change":"2023-11-24T07:57:43.537690+0000","last_active":"2023-11-24T07:57:43.540616+0000","last_peered":"2023-11-24T07:57:43.540616+0000","last_clean":"2023-11-24T07:57:43.540616+0000","last_became_active":"2023-11-24T07:57:43.537382+0000","last_became_peered":"2023-11-24T07:57:43.537382+0000","last_unstale":"2023-11-24T07:57:43.540616+0000","last_undegraded":"2023-11-24T07:57:43.540616+0000","last_fullsized":"2023-11-24T07:57:43.540616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:11.412465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719526+0000","last_change":"2023-11-24T07:57:43.536198+0000","last_active":"2023-11-24T07:57:45.719526+0000","last_peered":"2023-11-24T07:57:45.719526+0000","last_clean":"2023-11-24T07:57:45.719526+0000","last_became_active":"2023-11-24T07:57:43.535903+0000","last_became_peered":"2023-11-24T07:57:43.535903+0000","last_unstale":"2023-11-24T07:57:45.719526+0000","last_undegraded":"2023-11-24T07:57:45.719526+0000","last_fullsized":"2023-11-24T07:57:45.719526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:50.732941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.531609+0000","last_change":"2023-11-24T07:57:43.523758+0000","last_active":"2023-11-24T07:57:43.531609+0000","last_peered":"2023-11-24T07:57:43.531609+0000","last_clean":"2023-11-24T07:57:43.531609+0000","last_became_active":"2023-11-24T07:57:43.523476+0000","last_became_peered":"2023-11-24T07:57:43.523476+0000","last_unstale":"2023-11-24T07:57:43.531609+0000","last_undegraded":"2023-11-24T07:57:43.531609+0000","last_fullsized":"2023-11-24T07:57:43.531609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:29.129442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559638+0000","last_change":"2023-11-24T07:57:43.535284+0000","last_active":"2023-11-24T07:57:44.559638+0000","last_peered":"2023-11-24T07:57:44.559638+0000","last_clean":"2023-11-24T07:57:44.559638+0000","last_became_active":"2023-11-24T07:57:43.534974+0000","last_became_peered":"2023-11-24T07:57:43.534974+0000","last_unstale":"2023-11-24T07:57:44.559638+0000","last_undegraded":"2023-11-24T07:57:44.559638+0000","last_fullsized":"2023-11-24T07:57:44.559638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:09.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506505+0000","last_change":"2023-11-24T07:57:43.538331+0000","last_active":"2023-11-24T07:57:44.506505+0000","last_peered":"2023-11-24T07:57:44.506505+0000","last_clean":"2023-11-24T07:57:44.506505+0000","last_became_active":"2023-11-24T07:57:43.537928+0000","last_became_peered":"2023-11-24T07:57:43.537928+0000","last_unstale":"2023-11-24T07:57:44.506505+0000","last_undegraded":"2023-11-24T07:57:44.506505+0000","last_fullsized":"2023-11-24T07:57:44.506505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:29.506550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559518+0000","last_change":"2023-11-24T07:57:43.521319+0000","last_active":"2023-11-24T07:57:44.559518+0000","last_peered":"2023-11-24T07:57:44.559518+0000","last_clean":"2023-11-24T07:57:44.559518+0000","last_became_active":"2023-11-24T07:57:43.520870+0000","last_became_peered":"2023-11-24T07:57:43.520870+0000","last_unstale":"2023-11-24T07:57:44.559518+0000","last_undegraded":"2023-11-24T07:57:44.559518+0000","last_fullsized":"2023-11-24T07:57:44.559518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:23.209329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523748+0000","last_change":"2023-11-24T07:57:43.517888+0000","last_active":"2023-11-24T07:57:43.523748+0000","last_peered":"2023-11-24T07:57:43.523748+0000","last_clean":"2023-11-24T07:57:43.523748+0000","last_became_active":"2023-11-24T07:57:43.517593+0000","last_became_peered":"2023-11-24T07:57:43.517593+0000","last_unstale":"2023-11-24T07:57:43.523748+0000","last_undegraded":"2023-11-24T07:57:43.523748+0000","last_fullsized":"2023-11-24T07:57:43.523748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.541282+0000","last_change":"2023-11-24T07:57:43.538164+0000","last_active":"2023-11-24T07:57:43.541282+0000","last_peered":"2023-11-24T07:57:43.541282+0000","last_clean":"2023-11-24T07:57:43.541282+0000","last_became_active":"2023-11-24T07:57:43.537653+0000","last_became_peered":"2023-11-24T07:57:43.537653+0000","last_unstale":"2023-11-24T07:57:43.541282+0000","last_undegraded":"2023-11-24T07:57:43.541282+0000","last_fullsized":"2023-11-24T07:57:43.541282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:55.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506556+0000","last_change":"2023-11-24T07:57:43.534723+0000","last_active":"2023-11-24T07:57:44.506556+0000","last_peered":"2023-11-24T07:57:44.506556+0000","last_clean":"2023-11-24T07:57:44.506556+0000","last_became_active":"2023-11-24T07:57:43.534393+0000","last_became_peered":"2023-11-24T07:57:43.534393+0000","last_unstale":"2023-11-24T07:57:44.506556+0000","last_undegraded":"2023-11-24T07:57:44.506556+0000","last_fullsized":"2023-11-24T07:57:44.506556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:09.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506430+0000","last_change":"2023-11-24T07:57:43.525653+0000","last_active":"2023-11-24T07:57:44.506430+0000","last_peered":"2023-11-24T07:57:44.506430+0000","last_clean":"2023-11-24T07:57:44.506430+0000","last_became_active":"2023-11-24T07:57:43.525020+0000","last_became_peered":"2023-11-24T07:57:43.525020+0000","last_unstale":"2023-11-24T07:57:44.506430+0000","last_undegraded":"2023-11-24T07:57:44.506430+0000","last_fullsized":"2023-11-24T07:57:44.506430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506454+0000","last_change":"2023-11-24T07:57:43.532846+0000","last_active":"2023-11-24T07:57:44.506454+0000","last_peered":"2023-11-24T07:57:44.506454+0000","last_clean":"2023-11-24T07:57:44.506454+0000","last_became_active":"2023-11-24T07:57:43.531162+0000","last_became_peered":"2023-11-24T07:57:43.531162+0000","last_unstale":"2023-11-24T07:57:44.506454+0000","last_undegraded":"2023-11-24T07:57:44.506454+0000","last_fullsized":"2023-11-24T07:57:44.506454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:23.209329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719649+0000","last_change":"2023-11-24T07:57:43.535452+0000","last_active":"2023-11-24T07:57:45.719649+0000","last_peered":"2023-11-24T07:57:45.719649+0000","last_clean":"2023-11-24T07:57:45.719649+0000","last_became_active":"2023-11-24T07:57:43.535160+0000","last_became_peered":"2023-11-24T07:57:43.535160+0000","last_unstale":"2023-11-24T07:57:45.719649+0000","last_undegraded":"2023-11-24T07:57:45.719649+0000","last_fullsized":"2023-11-24T07:57:45.719649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507036+0000","last_change":"2023-11-24T07:57:42.518937+0000","last_active":"2023-11-24T07:57:44.507036+0000","last_peered":"2023-11-24T07:57:44.507036+0000","last_clean":"2023-11-24T07:57:44.507036+0000","last_became_active":"2023-11-24T07:57:42.518708+0000","last_became_peered":"2023-11-24T07:57:42.518708+0000","last_unstale":"2023-11-24T07:57:44.507036+0000","last_undegraded":"2023-11-24T07:57:44.507036+0000","last_fullsized":"2023-11-24T07:57:44.507036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506943+0000","last_change":"2023-11-24T07:57:43.526044+0000","last_active":"2023-11-24T07:57:44.506943+0000","last_peered":"2023-11-24T07:57:44.506943+0000","last_clean":"2023-11-24T07:57:44.506943+0000","last_became_active":"2023-11-24T07:57:43.525784+0000","last_became_peered":"2023-11-24T07:57:43.525784+0000","last_unstale":"2023-11-24T07:57:44.506943+0000","last_undegraded":"2023-11-24T07:57:44.506943+0000","last_fullsized":"2023-11-24T07:57:44.506943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:43.934399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719695+0000","last_change":"2023-11-24T07:57:42.510132+0000","last_active":"2023-11-24T07:57:45.719695+0000","last_peered":"2023-11-24T07:57:45.719695+0000","last_clean":"2023-11-24T07:57:45.719695+0000","last_became_active":"2023-11-24T07:57:42.509824+0000","last_became_peered":"2023-11-24T07:57:42.509824+0000","last_unstale":"2023-11-24T07:57:45.719695+0000","last_undegraded":"2023-11-24T07:57:45.719695+0000","last_fullsized":"2023-11-24T07:57:45.719695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.540756+0000","last_change":"2023-11-24T07:57:43.537923+0000","last_active":"2023-11-24T07:57:43.540756+0000","last_peered":"2023-11-24T07:57:43.540756+0000","last_clean":"2023-11-24T07:57:43.540756+0000","last_became_active":"2023-11-24T07:57:43.537632+0000","last_became_peered":"2023-11-24T07:57:43.537632+0000","last_unstale":"2023-11-24T07:57:43.540756+0000","last_undegraded":"2023-11-24T07:57:43.540756+0000","last_fullsized":"2023-11-24T07:57:43.540756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:41:07.289890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506092+0000","last_change":"2023-11-24T07:57:42.521734+0000","last_active":"2023-11-24T07:57:44.506092+0000","last_peered":"2023-11-24T07:57:44.506092+0000","last_clean":"2023-11-24T07:57:44.506092+0000","last_became_active":"2023-11-24T07:57:42.521036+0000","last_became_peered":"2023-11-24T07:57:42.521036+0000","last_unstale":"2023-11-24T07:57:44.506092+0000","last_undegraded":"2023-11-24T07:57:44.506092+0000","last_fullsized":"2023-11-24T07:57:44.506092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:16.061389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559576+0000","last_change":"2023-11-24T07:57:43.521140+0000","last_active":"2023-11-24T07:57:44.559576+0000","last_peered":"2023-11-24T07:57:44.559576+0000","last_clean":"2023-11-24T07:57:44.559576+0000","last_became_active":"2023-11-24T07:57:43.520510+0000","last_became_peered":"2023-11-24T07:57:43.520510+0000","last_unstale":"2023-11-24T07:57:44.559576+0000","last_undegraded":"2023-11-24T07:57:44.559576+0000","last_fullsized":"2023-11-24T07:57:44.559576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:50.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553228+0000","last_change":"2023-11-24T07:57:42.516005+0000","last_active":"2023-11-24T07:57:43.553228+0000","last_peered":"2023-11-24T07:57:43.553228+0000","last_clean":"2023-11-24T07:57:43.553228+0000","last_became_active":"2023-11-24T07:57:42.515583+0000","last_became_peered":"2023-11-24T07:57:42.515583+0000","last_unstale":"2023-11-24T07:57:43.553228+0000","last_undegraded":"2023-11-24T07:57:43.553228+0000","last_fullsized":"2023-11-24T07:57:43.553228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:41:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506985+0000","last_change":"2023-11-24T07:57:43.535064+0000","last_active":"2023-11-24T07:57:44.506985+0000","last_peered":"2023-11-24T07:57:44.506985+0000","last_clean":"2023-11-24T07:57:44.506985+0000","last_became_active":"2023-11-24T07:57:43.531634+0000","last_became_peered":"2023-11-24T07:57:43.531634+0000","last_unstale":"2023-11-24T07:57:44.506985+0000","last_undegraded":"2023-11-24T07:57:44.506985+0000","last_fullsized":"2023-11-24T07:57:44.506985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.548283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.550942+0000","last_change":"2023-11-24T07:57:42.509431+0000","last_active":"2023-11-24T07:57:43.550942+0000","last_peered":"2023-11-24T07:57:43.550942+0000","last_clean":"2023-11-24T07:57:43.550942+0000","last_became_active":"2023-11-24T07:57:42.507260+0000","last_became_peered":"2023-11-24T07:57:42.507260+0000","last_unstale":"2023-11-24T07:57:43.550942+0000","last_undegraded":"2023-11-24T07:57:43.550942+0000","last_fullsized":"2023-11-24T07:57:43.550942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.527520+0000","last_change":"2023-11-24T07:57:43.519494+0000","last_active":"2023-11-24T07:57:43.527520+0000","last_peered":"2023-11-24T07:57:43.527520+0000","last_clean":"2023-11-24T07:57:43.527520+0000","last_became_active":"2023-11-24T07:57:43.519209+0000","last_became_peered":"2023-11-24T07:57:43.519209+0000","last_unstale":"2023-11-24T07:57:43.527520+0000","last_undegraded":"2023-11-24T07:57:43.527520+0000","last_fullsized":"2023-11-24T07:57:43.527520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:35:21.240503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.550233+0000","last_change":"2023-11-24T07:57:42.507811+0000","last_active":"2023-11-24T07:57:43.550233+0000","last_peered":"2023-11-24T07:57:43.550233+0000","last_clean":"2023-11-24T07:57:43.550233+0000","last_became_active":"2023-11-24T07:57:42.507335+0000","last_became_peered":"2023-11-24T07:57:42.507335+0000","last_unstale":"2023-11-24T07:57:43.550233+0000","last_undegraded":"2023-11-24T07:57:43.550233+0000","last_fullsized":"2023-11-24T07:57:43.550233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:48:36.032820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.530163+0000","last_change":"2023-11-24T07:57:43.523756+0000","last_active":"2023-11-24T07:57:43.530163+0000","last_peered":"2023-11-24T07:57:43.530163+0000","last_clean":"2023-11-24T07:57:43.530163+0000","last_became_active":"2023-11-24T07:57:43.522391+0000","last_became_peered":"2023-11-24T07:57:43.522391+0000","last_unstale":"2023-11-24T07:57:43.530163+0000","last_undegraded":"2023-11-24T07:57:43.530163+0000","last_fullsized":"2023-11-24T07:57:43.530163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:54:49.412872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505583+0000","last_change":"2023-11-24T07:57:42.513841+0000","last_active":"2023-11-24T07:57:44.505583+0000","last_peered":"2023-11-24T07:57:44.505583+0000","last_clean":"2023-11-24T07:57:44.505583+0000","last_became_active":"2023-11-24T07:57:42.513533+0000","last_became_peered":"2023-11-24T07:57:42.513533+0000","last_unstale":"2023-11-24T07:57:44.505583+0000","last_undegraded":"2023-11-24T07:57:44.505583+0000","last_fullsized":"2023-11-24T07:57:44.505583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:08.206684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.558951+0000","last_change":"2023-11-24T07:57:43.527956+0000","last_active":"2023-11-24T07:57:44.558951+0000","last_peered":"2023-11-24T07:57:44.558951+0000","last_clean":"2023-11-24T07:57:44.558951+0000","last_became_active":"2023-11-24T07:57:43.527688+0000","last_became_peered":"2023-11-24T07:57:43.527688+0000","last_unstale":"2023-11-24T07:57:44.558951+0000","last_undegraded":"2023-11-24T07:57:44.558951+0000","last_fullsized":"2023-11-24T07:57:44.558951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:39.205186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.510406+0000","last_change":"2023-11-24T07:57:42.509142+0000","last_active":"2023-11-24T07:57:43.510406+0000","last_peered":"2023-11-24T07:57:43.510406+0000","last_clean":"2023-11-24T07:57:43.510406+0000","last_became_active":"2023-11-24T07:57:42.508818+0000","last_became_peered":"2023-11-24T07:57:42.508818+0000","last_unstale":"2023-11-24T07:57:43.510406+0000","last_undegraded":"2023-11-24T07:57:43.510406+0000","last_fullsized":"2023-11-24T07:57:43.510406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:51.591397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.534178+0000","last_change":"2023-11-24T07:57:43.531337+0000","last_active":"2023-11-24T07:57:43.534178+0000","last_peered":"2023-11-24T07:57:43.534178+0000","last_clean":"2023-11-24T07:57:43.534178+0000","last_became_active":"2023-11-24T07:57:43.531046+0000","last_became_peered":"2023-11-24T07:57:43.531046+0000","last_unstale":"2023-11-24T07:57:43.534178+0000","last_undegraded":"2023-11-24T07:57:43.534178+0000","last_fullsized":"2023-11-24T07:57:43.534178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:46.238920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506182+0000","last_change":"2023-11-24T07:57:42.520891+0000","last_active":"2023-11-24T07:57:44.506182+0000","last_peered":"2023-11-24T07:57:44.506182+0000","last_clean":"2023-11-24T07:57:44.506182+0000","last_became_active":"2023-11-24T07:57:42.520635+0000","last_became_peered":"2023-11-24T07:57:42.520635+0000","last_unstale":"2023-11-24T07:57:44.506182+0000","last_undegraded":"2023-11-24T07:57:44.506182+0000","last_fullsized":"2023-11-24T07:57:44.506182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:25.435977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506103+0000","last_change":"2023-11-24T07:57:43.527797+0000","last_active":"2023-11-24T07:57:44.506103+0000","last_peered":"2023-11-24T07:57:44.506103+0000","last_clean":"2023-11-24T07:57:44.506103+0000","last_became_active":"2023-11-24T07:57:43.527198+0000","last_became_peered":"2023-11-24T07:57:43.527198+0000","last_unstale":"2023-11-24T07:57:44.506103+0000","last_undegraded":"2023-11-24T07:57:44.506103+0000","last_fullsized":"2023-11-24T07:57:44.506103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:44.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719816+0000","last_change":"2023-11-24T07:57:42.521194+0000","last_active":"2023-11-24T07:57:45.719816+0000","last_peered":"2023-11-24T07:57:45.719816+0000","last_clean":"2023-11-24T07:57:45.719816+0000","last_became_active":"2023-11-24T07:57:42.520881+0000","last_became_peered":"2023-11-24T07:57:42.520881+0000","last_unstale":"2023-11-24T07:57:45.719816+0000","last_undegraded":"2023-11-24T07:57:45.719816+0000","last_fullsized":"2023-11-24T07:57:45.719816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506223+0000","last_change":"2023-11-24T07:57:43.538717+0000","last_active":"2023-11-24T07:57:44.506223+0000","last_peered":"2023-11-24T07:57:44.506223+0000","last_clean":"2023-11-24T07:57:44.506223+0000","last_became_active":"2023-11-24T07:57:43.538334+0000","last_became_peered":"2023-11-24T07:57:43.538334+0000","last_unstale":"2023-11-24T07:57:44.506223+0000","last_undegraded":"2023-11-24T07:57:44.506223+0000","last_fullsized":"2023-11-24T07:57:44.506223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:19.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.551203+0000","last_change":"2023-11-24T07:57:42.505000+0000","last_active":"2023-11-24T07:57:43.551203+0000","last_peered":"2023-11-24T07:57:43.551203+0000","last_clean":"2023-11-24T07:57:43.551203+0000","last_became_active":"2023-11-24T07:57:42.504484+0000","last_became_peered":"2023-11-24T07:57:42.504484+0000","last_unstale":"2023-11-24T07:57:43.551203+0000","last_undegraded":"2023-11-24T07:57:43.551203+0000","last_fullsized":"2023-11-24T07:57:43.551203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:42.928403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.529040+0000","last_change":"2023-11-24T07:57:43.522679+0000","last_active":"2023-11-24T07:57:43.529040+0000","last_peered":"2023-11-24T07:57:43.529040+0000","last_clean":"2023-11-24T07:57:43.529040+0000","last_became_active":"2023-11-24T07:57:43.522008+0000","last_became_peered":"2023-11-24T07:57:43.522008+0000","last_unstale":"2023-11-24T07:57:43.529040+0000","last_undegraded":"2023-11-24T07:57:43.529040+0000","last_fullsized":"2023-11-24T07:57:43.529040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506086+0000","last_change":"2023-11-24T07:57:42.520083+0000","last_active":"2023-11-24T07:57:44.506086+0000","last_peered":"2023-11-24T07:57:44.506086+0000","last_clean":"2023-11-24T07:57:44.506086+0000","last_became_active":"2023-11-24T07:57:42.519759+0000","last_became_peered":"2023-11-24T07:57:42.519759+0000","last_unstale":"2023-11-24T07:57:44.506086+0000","last_undegraded":"2023-11-24T07:57:44.506086+0000","last_fullsized":"2023-11-24T07:57:44.506086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:32.322346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559043+0000","last_change":"2023-11-24T07:57:43.527594+0000","last_active":"2023-11-24T07:57:44.559043+0000","last_peered":"2023-11-24T07:57:44.559043+0000","last_clean":"2023-11-24T07:57:44.559043+0000","last_became_active":"2023-11-24T07:57:43.527288+0000","last_became_peered":"2023-11-24T07:57:43.527288+0000","last_unstale":"2023-11-24T07:57:44.559043+0000","last_undegraded":"2023-11-24T07:57:44.559043+0000","last_fullsized":"2023-11-24T07:57:44.559043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:46.238920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553761+0000","last_change":"2023-11-24T07:57:42.510077+0000","last_active":"2023-11-24T07:57:43.553761+0000","last_peered":"2023-11-24T07:57:43.553761+0000","last_clean":"2023-11-24T07:57:43.553761+0000","last_became_active":"2023-11-24T07:57:42.509783+0000","last_became_peered":"2023-11-24T07:57:42.509783+0000","last_unstale":"2023-11-24T07:57:43.553761+0000","last_undegraded":"2023-11-24T07:57:43.553761+0000","last_fullsized":"2023-11-24T07:57:43.553761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505763+0000","last_change":"2023-11-24T07:57:43.524573+0000","last_active":"2023-11-24T07:57:44.505763+0000","last_peered":"2023-11-24T07:57:44.505763+0000","last_clean":"2023-11-24T07:57:44.505763+0000","last_became_active":"2023-11-24T07:57:43.524228+0000","last_became_peered":"2023-11-24T07:57:43.524228+0000","last_unstale":"2023-11-24T07:57:44.505763+0000","last_undegraded":"2023-11-24T07:57:44.505763+0000","last_fullsized":"2023-11-24T07:57:44.505763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:26:55.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.558960+0000","last_change":"2023-11-24T07:57:42.517296+0000","last_active":"2023-11-24T07:57:44.558960+0000","last_peered":"2023-11-24T07:57:44.558960+0000","last_clean":"2023-11-24T07:57:44.558960+0000","last_became_active":"2023-11-24T07:57:42.516844+0000","last_became_peered":"2023-11-24T07:57:42.516844+0000","last_unstale":"2023-11-24T07:57:44.558960+0000","last_undegraded":"2023-11-24T07:57:44.558960+0000","last_fullsized":"2023-11-24T07:57:44.558960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:27.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506551+0000","last_change":"2023-11-24T07:57:43.533751+0000","last_active":"2023-11-24T07:57:44.506551+0000","last_peered":"2023-11-24T07:57:44.506551+0000","last_clean":"2023-11-24T07:57:44.506551+0000","last_became_active":"2023-11-24T07:57:43.533273+0000","last_became_peered":"2023-11-24T07:57:43.533273+0000","last_unstale":"2023-11-24T07:57:44.506551+0000","last_undegraded":"2023-11-24T07:57:44.506551+0000","last_fullsized":"2023-11-24T07:57:44.506551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:50.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505473+0000","last_change":"2023-11-24T07:57:42.512341+0000","last_active":"2023-11-24T07:57:44.505473+0000","last_peered":"2023-11-24T07:57:44.505473+0000","last_clean":"2023-11-24T07:57:44.505473+0000","last_became_active":"2023-11-24T07:57:42.510737+0000","last_became_peered":"2023-11-24T07:57:42.510737+0000","last_unstale":"2023-11-24T07:57:44.505473+0000","last_undegraded":"2023-11-24T07:57:44.505473+0000","last_fullsized":"2023-11-24T07:57:44.505473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:49.148032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506187+0000","last_change":"2023-11-24T07:57:43.526634+0000","last_active":"2023-11-24T07:57:44.506187+0000","last_peered":"2023-11-24T07:57:44.506187+0000","last_clean":"2023-11-24T07:57:44.506187+0000","last_became_active":"2023-11-24T07:57:43.526373+0000","last_became_peered":"2023-11-24T07:57:43.526373+0000","last_unstale":"2023-11-24T07:57:44.506187+0000","last_undegraded":"2023-11-24T07:57:44.506187+0000","last_fullsized":"2023-11-24T07:57:44.506187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:50.732941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505610+0000","last_change":"2023-11-24T07:57:42.522278+0000","last_active":"2023-11-24T07:57:44.505610+0000","last_peered":"2023-11-24T07:57:44.505610+0000","last_clean":"2023-11-24T07:57:44.505610+0000","last_became_active":"2023-11-24T07:57:42.519817+0000","last_became_peered":"2023-11-24T07:57:42.519817+0000","last_unstale":"2023-11-24T07:57:44.505610+0000","last_undegraded":"2023-11-24T07:57:44.505610+0000","last_fullsized":"2023-11-24T07:57:44.505610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:22.203333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523820+0000","last_change":"2023-11-24T07:57:43.518462+0000","last_active":"2023-11-24T07:57:43.523820+0000","last_peered":"2023-11-24T07:57:43.523820+0000","last_clean":"2023-11-24T07:57:43.523820+0000","last_became_active":"2023-11-24T07:57:43.518116+0000","last_became_peered":"2023-11-24T07:57:43.518116+0000","last_unstale":"2023-11-24T07:57:43.523820+0000","last_undegraded":"2023-11-24T07:57:43.523820+0000","last_fullsized":"2023-11-24T07:57:43.523820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:59.714178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559683+0000","last_change":"2023-11-24T07:57:42.524067+0000","last_active":"2023-11-24T07:57:44.559683+0000","last_peered":"2023-11-24T07:57:44.559683+0000","last_clean":"2023-11-24T07:57:44.559683+0000","last_became_active":"2023-11-24T07:57:42.523783+0000","last_became_peered":"2023-11-24T07:57:42.523783+0000","last_unstale":"2023-11-24T07:57:44.559683+0000","last_undegraded":"2023-11-24T07:57:44.559683+0000","last_fullsized":"2023-11-24T07:57:44.559683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:02.730087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.532605+0000","last_change":"2023-11-24T07:57:43.525961+0000","last_active":"2023-11-24T07:57:43.532605+0000","last_peered":"2023-11-24T07:57:43.532605+0000","last_clean":"2023-11-24T07:57:43.532605+0000","last_became_active":"2023-11-24T07:57:43.521932+0000","last_became_peered":"2023-11-24T07:57:43.521932+0000","last_unstale":"2023-11-24T07:57:43.532605+0000","last_undegraded":"2023-11-24T07:57:43.532605+0000","last_fullsized":"2023-11-24T07:57:43.532605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:41.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553667+0000","last_change":"2023-11-24T07:57:42.510192+0000","last_active":"2023-11-24T07:57:43.553667+0000","last_peered":"2023-11-24T07:57:43.553667+0000","last_clean":"2023-11-24T07:57:43.553667+0000","last_became_active":"2023-11-24T07:57:42.509870+0000","last_became_peered":"2023-11-24T07:57:42.509870+0000","last_unstale":"2023-11-24T07:57:43.553667+0000","last_undegraded":"2023-11-24T07:57:43.553667+0000","last_fullsized":"2023-11-24T07:57:43.553667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:39.208072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559343+0000","last_change":"2023-11-24T07:57:43.522209+0000","last_active":"2023-11-24T07:57:44.559343+0000","last_peered":"2023-11-24T07:57:44.559343+0000","last_clean":"2023-11-24T07:57:44.559343+0000","last_became_active":"2023-11-24T07:57:43.521893+0000","last_became_peered":"2023-11-24T07:57:43.521893+0000","last_unstale":"2023-11-24T07:57:44.559343+0000","last_undegraded":"2023-11-24T07:57:44.559343+0000","last_fullsized":"2023-11-24T07:57:44.559343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:41.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.551136+0000","last_change":"2023-11-24T07:57:42.508655+0000","last_active":"2023-11-24T07:57:43.551136+0000","last_peered":"2023-11-24T07:57:43.551136+0000","last_clean":"2023-11-24T07:57:43.551136+0000","last_became_active":"2023-11-24T07:57:42.508338+0000","last_became_peered":"2023-11-24T07:57:42.508338+0000","last_unstale":"2023-11-24T07:57:43.551136+0000","last_undegraded":"2023-11-24T07:57:43.551136+0000","last_fullsized":"2023-11-24T07:57:43.551136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.536628+0000","last_change":"2023-11-24T07:57:43.535093+0000","last_active":"2023-11-24T07:57:43.536628+0000","last_peered":"2023-11-24T07:57:43.536628+0000","last_clean":"2023-11-24T07:57:43.536628+0000","last_became_active":"2023-11-24T07:57:43.534770+0000","last_became_peered":"2023-11-24T07:57:43.534770+0000","last_unstale":"2023-11-24T07:57:43.536628+0000","last_undegraded":"2023-11-24T07:57:43.536628+0000","last_fullsized":"2023-11-24T07:57:43.536628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:59.714178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.507025+0000","last_change":"2023-11-24T07:57:42.514769+0000","last_active":"2023-11-24T07:57:43.507025+0000","last_peered":"2023-11-24T07:57:43.507025+0000","last_clean":"2023-11-24T07:57:43.507025+0000","last_became_active":"2023-11-24T07:57:42.514472+0000","last_became_peered":"2023-11-24T07:57:42.514472+0000","last_unstale":"2023-11-24T07:57:43.507025+0000","last_undegraded":"2023-11-24T07:57:43.507025+0000","last_fullsized":"2023-11-24T07:57:43.507025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:08.392246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.522574+0000","last_change":"2023-11-24T07:57:43.516678+0000","last_active":"2023-11-24T07:57:43.522574+0000","last_peered":"2023-11-24T07:57:43.522574+0000","last_clean":"2023-11-24T07:57:43.522574+0000","last_became_active":"2023-11-24T07:57:43.516379+0000","last_became_peered":"2023-11-24T07:57:43.516379+0000","last_unstale":"2023-11-24T07:57:43.522574+0000","last_undegraded":"2023-11-24T07:57:43.522574+0000","last_fullsized":"2023-11-24T07:57:43.522574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:44:50.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719872+0000","last_change":"2023-11-24T07:57:42.515029+0000","last_active":"2023-11-24T07:57:45.719872+0000","last_peered":"2023-11-24T07:57:45.719872+0000","last_clean":"2023-11-24T07:57:45.719872+0000","last_became_active":"2023-11-24T07:57:42.514747+0000","last_became_peered":"2023-11-24T07:57:42.514747+0000","last_unstale":"2023-11-24T07:57:45.719872+0000","last_undegraded":"2023-11-24T07:57:45.719872+0000","last_fullsized":"2023-11-24T07:57:45.719872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:51.591397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525023+0000","last_change":"2023-11-24T07:57:43.520097+0000","last_active":"2023-11-24T07:57:43.525023+0000","last_peered":"2023-11-24T07:57:43.525023+0000","last_clean":"2023-11-24T07:57:43.525023+0000","last_became_active":"2023-11-24T07:57:43.519803+0000","last_became_peered":"2023-11-24T07:57:43.519803+0000","last_unstale":"2023-11-24T07:57:43.525023+0000","last_undegraded":"2023-11-24T07:57:43.525023+0000","last_fullsized":"2023-11-24T07:57:43.525023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:52.603918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506352+0000","last_change":"2023-11-24T07:57:42.517859+0000","last_active":"2023-11-24T07:57:44.506352+0000","last_peered":"2023-11-24T07:57:44.506352+0000","last_clean":"2023-11-24T07:57:44.506352+0000","last_became_active":"2023-11-24T07:57:42.517080+0000","last_became_peered":"2023-11-24T07:57:42.517080+0000","last_unstale":"2023-11-24T07:57:44.506352+0000","last_undegraded":"2023-11-24T07:57:44.506352+0000","last_fullsized":"2023-11-24T07:57:44.506352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523814+0000","last_change":"2023-11-24T07:57:43.517039+0000","last_active":"2023-11-24T07:57:43.523814+0000","last_peered":"2023-11-24T07:57:43.523814+0000","last_clean":"2023-11-24T07:57:43.523814+0000","last_became_active":"2023-11-24T07:57:43.516761+0000","last_became_peered":"2023-11-24T07:57:43.516761+0000","last_unstale":"2023-11-24T07:57:43.523814+0000","last_undegraded":"2023-11-24T07:57:43.523814+0000","last_fullsized":"2023-11-24T07:57:43.523814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:49.043173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.509971+0000","last_change":"2023-11-24T07:57:42.512097+0000","last_active":"2023-11-24T07:57:43.509971+0000","last_peered":"2023-11-24T07:57:43.509971+0000","last_clean":"2023-11-24T07:57:43.509971+0000","last_became_active":"2023-11-24T07:57:42.511754+0000","last_became_peered":"2023-11-24T07:57:42.511754+0000","last_unstale":"2023-11-24T07:57:43.509971+0000","last_undegraded":"2023-11-24T07:57:43.509971+0000","last_fullsized":"2023-11-24T07:57:43.509971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:28:35.261475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506935+0000","last_change":"2023-11-24T07:57:43.534606+0000","last_active":"2023-11-24T07:57:44.506935+0000","last_peered":"2023-11-24T07:57:44.506935+0000","last_clean":"2023-11-24T07:57:44.506935+0000","last_became_active":"2023-11-24T07:57:43.531913+0000","last_became_peered":"2023-11-24T07:57:43.531913+0000","last_unstale":"2023-11-24T07:57:44.506935+0000","last_undegraded":"2023-11-24T07:57:44.506935+0000","last_fullsized":"2023-11-24T07:57:44.506935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:26.441973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.506582+0000","last_change":"2023-11-24T07:57:42.509431+0000","last_active":"2023-11-24T07:57:43.506582+0000","last_peered":"2023-11-24T07:57:43.506582+0000","last_clean":"2023-11-24T07:57:43.506582+0000","last_became_active":"2023-11-24T07:57:42.509107+0000","last_became_peered":"2023-11-24T07:57:42.509107+0000","last_unstale":"2023-11-24T07:57:43.506582+0000","last_undegraded":"2023-11-24T07:57:43.506582+0000","last_fullsized":"2023-11-24T07:57:43.506582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:49.726945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525794+0000","last_change":"2023-11-24T07:57:43.523334+0000","last_active":"2023-11-24T07:57:43.525794+0000","last_peered":"2023-11-24T07:57:43.525794+0000","last_clean":"2023-11-24T07:57:43.525794+0000","last_became_active":"2023-11-24T07:57:43.522949+0000","last_became_peered":"2023-11-24T07:57:43.522949+0000","last_unstale":"2023-11-24T07:57:43.525794+0000","last_undegraded":"2023-11-24T07:57:43.525794+0000","last_fullsized":"2023-11-24T07:57:43.525794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:09.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559727+0000","last_change":"2023-11-24T07:57:42.522223+0000","last_active":"2023-11-24T07:57:44.559727+0000","last_peered":"2023-11-24T07:57:44.559727+0000","last_clean":"2023-11-24T07:57:44.559727+0000","last_became_active":"2023-11-24T07:57:42.521543+0000","last_became_peered":"2023-11-24T07:57:42.521543+0000","last_unstale":"2023-11-24T07:57:44.559727+0000","last_undegraded":"2023-11-24T07:57:44.559727+0000","last_fullsized":"2023-11-24T07:57:44.559727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:42.928403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.528889+0000","last_change":"2023-11-24T07:57:43.521064+0000","last_active":"2023-11-24T07:57:43.528889+0000","last_peered":"2023-11-24T07:57:43.528889+0000","last_clean":"2023-11-24T07:57:43.528889+0000","last_became_active":"2023-11-24T07:57:43.520767+0000","last_became_peered":"2023-11-24T07:57:43.520767+0000","last_unstale":"2023-11-24T07:57:43.528889+0000","last_undegraded":"2023-11-24T07:57:43.528889+0000","last_fullsized":"2023-11-24T07:57:43.528889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:16.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.721370+0000","last_change":"2023-11-24T07:57:42.515847+0000","last_active":"2023-11-24T07:57:45.721370+0000","last_peered":"2023-11-24T07:57:45.721370+0000","last_clean":"2023-11-24T07:57:45.721370+0000","last_became_active":"2023-11-24T07:57:42.515511+0000","last_became_peered":"2023-11-24T07:57:42.515511+0000","last_unstale":"2023-11-24T07:57:45.721370+0000","last_undegraded":"2023-11-24T07:57:45.721370+0000","last_fullsized":"2023-11-24T07:57:45.721370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:25.408976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719584+0000","last_change":"2023-11-24T07:57:43.517823+0000","last_active":"2023-11-24T07:57:45.719584+0000","last_peered":"2023-11-24T07:57:45.719584+0000","last_clean":"2023-11-24T07:57:45.719584+0000","last_became_active":"2023-11-24T07:57:43.516270+0000","last_became_peered":"2023-11-24T07:57:43.516270+0000","last_unstale":"2023-11-24T07:57:45.719584+0000","last_undegraded":"2023-11-24T07:57:45.719584+0000","last_fullsized":"2023-11-24T07:57:45.719584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559442+0000","last_change":"2023-11-24T07:57:42.513011+0000","last_active":"2023-11-24T07:57:44.559442+0000","last_peered":"2023-11-24T07:57:44.559442+0000","last_clean":"2023-11-24T07:57:44.559442+0000","last_became_active":"2023-11-24T07:57:42.512711+0000","last_became_peered":"2023-11-24T07:57:42.512711+0000","last_unstale":"2023-11-24T07:57:44.559442+0000","last_undegraded":"2023-11-24T07:57:44.559442+0000","last_fullsized":"2023-11-24T07:57:44.559442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:49.726945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506261+0000","last_change":"2023-11-24T07:57:43.529658+0000","last_active":"2023-11-24T07:57:44.506261+0000","last_peered":"2023-11-24T07:57:44.506261+0000","last_clean":"2023-11-24T07:57:44.506261+0000","last_became_active":"2023-11-24T07:57:43.529325+0000","last_became_peered":"2023-11-24T07:57:43.529325+0000","last_unstale":"2023-11-24T07:57:44.506261+0000","last_undegraded":"2023-11-24T07:57:44.506261+0000","last_fullsized":"2023-11-24T07:57:44.506261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719933+0000","last_change":"2023-11-24T07:57:42.513813+0000","last_active":"2023-11-24T07:57:45.719933+0000","last_peered":"2023-11-24T07:57:45.719933+0000","last_clean":"2023-11-24T07:57:45.719933+0000","last_became_active":"2023-11-24T07:57:42.513452+0000","last_became_peered":"2023-11-24T07:57:42.513452+0000","last_unstale":"2023-11-24T07:57:45.719933+0000","last_undegraded":"2023-11-24T07:57:45.719933+0000","last_fullsized":"2023-11-24T07:57:45.719933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719854+0000","last_change":"2023-11-24T07:57:43.530343+0000","last_active":"2023-11-24T07:57:45.719854+0000","last_peered":"2023-11-24T07:57:45.719854+0000","last_clean":"2023-11-24T07:57:45.719854+0000","last_became_active":"2023-11-24T07:57:43.530031+0000","last_became_peered":"2023-11-24T07:57:43.530031+0000","last_unstale":"2023-11-24T07:57:45.719854+0000","last_undegraded":"2023-11-24T07:57:45.719854+0000","last_fullsized":"2023-11-24T07:57:45.719854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559013+0000","last_change":"2023-11-24T07:57:42.522901+0000","last_active":"2023-11-24T07:57:44.559013+0000","last_peered":"2023-11-24T07:57:44.559013+0000","last_clean":"2023-11-24T07:57:44.559013+0000","last_became_active":"2023-11-24T07:57:42.521862+0000","last_became_peered":"2023-11-24T07:57:42.521862+0000","last_unstale":"2023-11-24T07:57:44.559013+0000","last_undegraded":"2023-11-24T07:57:44.559013+0000","last_fullsized":"2023-11-24T07:57:44.559013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:15.481860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505518+0000","last_change":"2023-11-24T07:57:43.526811+0000","last_active":"2023-11-24T07:57:44.505518+0000","last_peered":"2023-11-24T07:57:44.505518+0000","last_clean":"2023-11-24T07:57:44.505518+0000","last_became_active":"2023-11-24T07:57:43.526565+0000","last_became_peered":"2023-11-24T07:57:43.526565+0000","last_unstale":"2023-11-24T07:57:44.505518+0000","last_undegraded":"2023-11-24T07:57:44.505518+0000","last_fullsized":"2023-11-24T07:57:44.505518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:31.057524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.509970+0000","last_change":"2023-11-24T07:57:42.502280+0000","last_active":"2023-11-24T07:57:43.509970+0000","last_peered":"2023-11-24T07:57:43.509970+0000","last_clean":"2023-11-24T07:57:43.509970+0000","last_became_active":"2023-11-24T07:57:42.501833+0000","last_became_peered":"2023-11-24T07:57:42.501833+0000","last_unstale":"2023-11-24T07:57:43.509970+0000","last_undegraded":"2023-11-24T07:57:43.509970+0000","last_fullsized":"2023-11-24T07:57:43.509970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:30.507547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.541287+0000","last_change":"2023-11-24T07:57:43.538145+0000","last_active":"2023-11-24T07:57:43.541287+0000","last_peered":"2023-11-24T07:57:43.541287+0000","last_clean":"2023-11-24T07:57:43.541287+0000","last_became_active":"2023-11-24T07:57:43.537685+0000","last_became_peered":"2023-11-24T07:57:43.537685+0000","last_unstale":"2023-11-24T07:57:43.541287+0000","last_undegraded":"2023-11-24T07:57:43.541287+0000","last_fullsized":"2023-11-24T07:57:43.541287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:28.365343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505524+0000","last_change":"2023-11-24T07:57:42.510968+0000","last_active":"2023-11-24T07:57:44.505524+0000","last_peered":"2023-11-24T07:57:44.505524+0000","last_clean":"2023-11-24T07:57:44.505524+0000","last_became_active":"2023-11-24T07:57:42.510626+0000","last_became_peered":"2023-11-24T07:57:42.510626+0000","last_unstale":"2023-11-24T07:57:44.505524+0000","last_undegraded":"2023-11-24T07:57:44.505524+0000","last_fullsized":"2023-11-24T07:57:44.505524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:43.401699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506925+0000","last_change":"2023-11-24T07:57:43.532363+0000","last_active":"2023-11-24T07:57:44.506925+0000","last_peered":"2023-11-24T07:57:44.506925+0000","last_clean":"2023-11-24T07:57:44.506925+0000","last_became_active":"2023-11-24T07:57:43.532080+0000","last_became_peered":"2023-11-24T07:57:43.532080+0000","last_unstale":"2023-11-24T07:57:44.506925+0000","last_undegraded":"2023-11-24T07:57:44.506925+0000","last_fullsized":"2023-11-24T07:57:44.506925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:17.067385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506091+0000","last_change":"2023-11-24T07:57:42.515327+0000","last_active":"2023-11-24T07:57:44.506091+0000","last_peered":"2023-11-24T07:57:44.506091+0000","last_clean":"2023-11-24T07:57:44.506091+0000","last_became_active":"2023-11-24T07:57:42.515049+0000","last_became_peered":"2023-11-24T07:57:42.515049+0000","last_unstale":"2023-11-24T07:57:44.506091+0000","last_undegraded":"2023-11-24T07:57:44.506091+0000","last_fullsized":"2023-11-24T07:57:44.506091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.516052+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:57:43.516052+0000","last_peered":"2023-11-24T07:57:43.516052+0000","last_clean":"2023-11-24T07:57:43.516052+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:57:43.516052+0000","last_undegraded":"2023-11-24T07:57:43.516052+0000","last_fullsized":"2023-11-24T07:57:43.516052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.442},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.83599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.752}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.499}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.82799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":144650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.877},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":152514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.877}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":741248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68700000000000006}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:57:47.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:57:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.805+0000 7f2a5993e640 1 Processor -- start 2023-11-24T07:57:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.805+0000 7f2a5993e640 1 -- start start 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a5993e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a540b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a5993e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a540adcc0 0x7f2a540ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a5993e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540b2480 con 0x7f2a5406dfd0 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a5993e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a54070670 con 0x7f2a540adcc0 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a5993e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54070950 con 0x7f2a54143ae0 2023-11-24T07:57:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a540adcc0 0x7f2a540ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a540adcc0 0x7f2a540ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52870/0 (socket says 172.21.15.5:52870) 2023-11-24T07:57:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 -- 172.21.15.5:0/2512773291 learned_addr learned my addr 172.21.15.5:0/2512773291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a52ffd640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a540b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 -- 172.21.15.5:0/2512773291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 msgr2=0x7f2a540b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a540b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 -- 172.21.15.5:0/2512773291 >> v1:172.21.15.102:6789/0 conn(0x7f2a5406dfd0 legacy=0x7f2a5406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 -- 172.21.15.5:0/2512773291 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54070c30 con 0x7f2a540adcc0 2023-11-24T07:57:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.809+0000 7f2a537fe640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a540adcc0 0x7f2a540ae110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009e50 tx=0x7f2a4c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81da419b38ab988b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a527fc640 1 -- 172.21.15.5:0/2512773291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0a58a0 con 0x7f2a540adcc0 2023-11-24T07:57:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a527fc640 1 -- 172.21.15.5:0/2512773291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c0a5a00 con 0x7f2a540adcc0 2023-11-24T07:57:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a527fc640 1 -- 172.21.15.5:0/2512773291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0a5d90 con 0x7f2a540adcc0 2023-11-24T07:57:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- 172.21.15.5:0/2512773291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a540adcc0 msgr2=0x7f2a540ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a540adcc0 0x7f2a540ae110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009e50 tx=0x7f2a4c01c9e0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- 172.21.15.5:0/2512773291 shutdown_connections 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a540adcc0 0x7f2a540ae110 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- 172.21.15.5:0/2512773291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a540b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- 172.21.15.5:0/2512773291 >> 172.21.15.5:0/2512773291 conn(0x7f2a540b0c40 msgr2=0x7f2a540b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- 172.21.15.5:0/2512773291 shutdown_connections 2023-11-24T07:57:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- 172.21.15.5:0/2512773291 wait complete. 2023-11-24T07:57:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 Processor -- start 2023-11-24T07:57:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- start start 2023-11-24T07:57:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540adcc0 0x7f2a5415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a5415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5409c370 con 0x7f2a5406dfd0 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415fd70 con 0x7f2a540adcc0 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a5993e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5409c860 con 0x7f2a54143ae0 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52878/0 (socket says 172.21.15.5:52878) 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a52ffd640 1 -- 172.21.15.5:0/487515040 learned_addr learned my addr 172.21.15.5:0/487515040 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.813+0000 7f2a4bfff640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540adcc0 0x7f2a5415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a537fe640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a5415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 -- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 msgr2=0x7f2a5415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a5415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 -- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540adcc0 msgr2=0x7f2a5415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540adcc0 0x7f2a5415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 -- 172.21.15.5:0/487515040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009b30 con 0x7f2a5406dfd0 2023-11-24T07:57:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a52ffd640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d5f0 tx=0x7f2a4400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440125f0 con 0x7f2a5406dfd0 2023-11-24T07:57:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44012750 con 0x7f2a5406dfd0 2023-11-24T07:57:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44012ae0 con 0x7f2a5406dfd0 2023-11-24T07:57:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5409b9d0 con 0x7f2a5406dfd0 2023-11-24T07:57:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5409bf90 con 0x7f2a5406dfd0 2023-11-24T07:57:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5404e850 con 0x7f2a5406dfd0 2023-11-24T07:57:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.817+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a44012c40 con 0x7f2a5406dfd0 2023-11-24T07:57:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.821+0000 7f2a50ff9640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 0x7f2a34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.821+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a44084190 con 0x7f2a5406dfd0 2023-11-24T07:57:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.821+0000 7f2a4bfff640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 0x7f2a34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.821+0000 7f2a4bfff640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 0x7f2a34068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a5406db60 tx=0x7f2a3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.825+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a440516b0 con 0x7f2a5406dfd0 2023-11-24T07:57:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.977+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a54141740 con 0x7f2a34066470 2023-11-24T07:57:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.985+0000 7f2a50ff9640 1 -- 172.21.15.5:0/487515040 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288891 (secure 0 0 0) 0x7f2a54141740 con 0x7f2a34066470 2023-11-24T07:57:47.992 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:57:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 msgr2=0x7f2a34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 0x7f2a34068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a5406db60 tx=0x7f2a3c009040 comp rx=0 tx=0).stop 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 msgr2=0x7f2a5413fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d5f0 tx=0x7f2a4400dab0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 shutdown_connections 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2a34066470 0x7f2a34068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a54143ae0 0x7f2a5415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540adcc0 0x7f2a5415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 --2- 172.21.15.5:0/487515040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5406dfd0 0x7f2a5413fcc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 >> 172.21.15.5:0/487515040 conn(0x7f2a540b0c40 msgr2=0x7f2a540b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 shutdown_connections 2023-11-24T07:57:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:47.989+0000 7f2a5993e640 1 -- 172.21.15.5:0/487515040 wait complete. 2023-11-24T07:57:48.012 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-24T07:57:47.248151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237000,"kb_used_data":4180,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737720,"statfs":{"total":773094113280,"available":772851425280,"internally_reserved":0,"allocated":4280320,"data_stored":2377772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762546"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506237+0000","last_change":"2023-11-24T07:57:43.530181+0000","last_active":"2023-11-24T07:57:44.506237+0000","last_peered":"2023-11-24T07:57:44.506237+0000","last_clean":"2023-11-24T07:57:44.506237+0000","last_became_active":"2023-11-24T07:57:43.529754+0000","last_became_peered":"2023-11-24T07:57:43.529754+0000","last_unstale":"2023-11-24T07:57:44.506237+0000","last_undegraded":"2023-11-24T07:57:44.506237+0000","last_fullsized":"2023-11-24T07:57:44.506237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506352+0000","last_change":"2023-11-24T07:57:43.529706+0000","last_active":"2023-11-24T07:57:44.506352+0000","last_peered":"2023-11-24T07:57:44.506352+0000","last_clean":"2023-11-24T07:57:44.506352+0000","last_became_active":"2023-11-24T07:57:43.529246+0000","last_became_peered":"2023-11-24T07:57:43.529246+0000","last_unstale":"2023-11-24T07:57:44.506352+0000","last_undegraded":"2023-11-24T07:57:44.506352+0000","last_fullsized":"2023-11-24T07:57:44.506352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:01:56.947543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.528863+0000","last_change":"2023-11-24T07:57:43.521224+0000","last_active":"2023-11-24T07:57:43.528863+0000","last_peered":"2023-11-24T07:57:43.528863+0000","last_clean":"2023-11-24T07:57:43.528863+0000","last_became_active":"2023-11-24T07:57:43.520946+0000","last_became_peered":"2023-11-24T07:57:43.520946+0000","last_unstale":"2023-11-24T07:57:43.528863+0000","last_undegraded":"2023-11-24T07:57:43.528863+0000","last_fullsized":"2023-11-24T07:57:43.528863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559338+0000","last_change":"2023-11-24T07:57:43.521943+0000","last_active":"2023-11-24T07:57:44.559338+0000","last_peered":"2023-11-24T07:57:44.559338+0000","last_clean":"2023-11-24T07:57:44.559338+0000","last_became_active":"2023-11-24T07:57:43.521655+0000","last_became_peered":"2023-11-24T07:57:43.521655+0000","last_unstale":"2023-11-24T07:57:44.559338+0000","last_undegraded":"2023-11-24T07:57:44.559338+0000","last_fullsized":"2023-11-24T07:57:44.559338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:16.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.527516+0000","last_change":"2023-11-24T07:57:43.525661+0000","last_active":"2023-11-24T07:57:43.527516+0000","last_peered":"2023-11-24T07:57:43.527516+0000","last_clean":"2023-11-24T07:57:43.527516+0000","last_became_active":"2023-11-24T07:57:43.525384+0000","last_became_peered":"2023-11-24T07:57:43.525384+0000","last_unstale":"2023-11-24T07:57:43.527516+0000","last_undegraded":"2023-11-24T07:57:43.527516+0000","last_fullsized":"2023-11-24T07:57:43.527516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:05:45.177486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505752+0000","last_change":"2023-11-24T07:57:43.530071+0000","last_active":"2023-11-24T07:57:44.505752+0000","last_peered":"2023-11-24T07:57:44.505752+0000","last_clean":"2023-11-24T07:57:44.505752+0000","last_became_active":"2023-11-24T07:57:43.529547+0000","last_became_peered":"2023-11-24T07:57:43.529547+0000","last_unstale":"2023-11-24T07:57:44.505752+0000","last_undegraded":"2023-11-24T07:57:44.505752+0000","last_fullsized":"2023-11-24T07:57:44.505752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.548283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507059+0000","last_change":"2023-11-24T07:57:43.532405+0000","last_active":"2023-11-24T07:57:44.507059+0000","last_peered":"2023-11-24T07:57:44.507059+0000","last_clean":"2023-11-24T07:57:44.507059+0000","last_became_active":"2023-11-24T07:57:43.531577+0000","last_became_peered":"2023-11-24T07:57:43.531577+0000","last_unstale":"2023-11-24T07:57:44.507059+0000","last_undegraded":"2023-11-24T07:57:44.507059+0000","last_fullsized":"2023-11-24T07:57:44.507059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:26:55.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506315+0000","last_change":"2023-11-24T07:57:43.531282+0000","last_active":"2023-11-24T07:57:44.506315+0000","last_peered":"2023-11-24T07:57:44.506315+0000","last_clean":"2023-11-24T07:57:44.506315+0000","last_became_active":"2023-11-24T07:57:43.530566+0000","last_became_peered":"2023-11-24T07:57:43.530566+0000","last_unstale":"2023-11-24T07:57:44.506315+0000","last_undegraded":"2023-11-24T07:57:44.506315+0000","last_fullsized":"2023-11-24T07:57:44.506315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:44.407695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.521725+0000","last_change":"2023-11-24T07:57:43.514679+0000","last_active":"2023-11-24T07:57:43.521725+0000","last_peered":"2023-11-24T07:57:43.521725+0000","last_clean":"2023-11-24T07:57:43.521725+0000","last_became_active":"2023-11-24T07:57:43.514386+0000","last_became_peered":"2023-11-24T07:57:43.514386+0000","last_unstale":"2023-11-24T07:57:43.521725+0000","last_undegraded":"2023-11-24T07:57:43.521725+0000","last_fullsized":"2023-11-24T07:57:43.521725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:52.603918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559439+0000","last_change":"2023-11-24T07:57:43.531435+0000","last_active":"2023-11-24T07:57:44.559439+0000","last_peered":"2023-11-24T07:57:44.559439+0000","last_clean":"2023-11-24T07:57:44.559439+0000","last_became_active":"2023-11-24T07:57:43.531088+0000","last_became_peered":"2023-11-24T07:57:43.531088+0000","last_unstale":"2023-11-24T07:57:44.559439+0000","last_undegraded":"2023-11-24T07:57:44.559439+0000","last_fullsized":"2023-11-24T07:57:44.559439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:44.407695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506944+0000","last_change":"2023-11-24T07:57:43.532524+0000","last_active":"2023-11-24T07:57:44.506944+0000","last_peered":"2023-11-24T07:57:44.506944+0000","last_clean":"2023-11-24T07:57:44.506944+0000","last_became_active":"2023-11-24T07:57:43.532129+0000","last_became_peered":"2023-11-24T07:57:43.532129+0000","last_unstale":"2023-11-24T07:57:44.506944+0000","last_undegraded":"2023-11-24T07:57:44.506944+0000","last_fullsized":"2023-11-24T07:57:44.506944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:31.057524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.535679+0000","last_change":"2023-11-24T07:57:43.532647+0000","last_active":"2023-11-24T07:57:43.535679+0000","last_peered":"2023-11-24T07:57:43.535679+0000","last_clean":"2023-11-24T07:57:43.535679+0000","last_became_active":"2023-11-24T07:57:43.531658+0000","last_became_peered":"2023-11-24T07:57:43.531658+0000","last_unstale":"2023-11-24T07:57:43.535679+0000","last_undegraded":"2023-11-24T07:57:43.535679+0000","last_fullsized":"2023-11-24T07:57:43.535679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:39.205186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.521249+0000","last_change":"2023-11-24T07:57:43.513249+0000","last_active":"2023-11-24T07:57:43.521249+0000","last_peered":"2023-11-24T07:57:43.521249+0000","last_clean":"2023-11-24T07:57:43.521249+0000","last_became_active":"2023-11-24T07:57:43.512928+0000","last_became_peered":"2023-11-24T07:57:43.512928+0000","last_unstale":"2023-11-24T07:57:43.521249+0000","last_undegraded":"2023-11-24T07:57:43.521249+0000","last_fullsized":"2023-11-24T07:57:43.521249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:37.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505814+0000","last_change":"2023-11-24T07:57:43.529829+0000","last_active":"2023-11-24T07:57:44.505814+0000","last_peered":"2023-11-24T07:57:44.505814+0000","last_clean":"2023-11-24T07:57:44.505814+0000","last_became_active":"2023-11-24T07:57:43.529196+0000","last_became_peered":"2023-11-24T07:57:43.529196+0000","last_unstale":"2023-11-24T07:57:44.505814+0000","last_undegraded":"2023-11-24T07:57:44.505814+0000","last_fullsized":"2023-11-24T07:57:44.505814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:25.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.529124+0000","last_change":"2023-11-24T07:57:43.522711+0000","last_active":"2023-11-24T07:57:43.529124+0000","last_peered":"2023-11-24T07:57:43.529124+0000","last_clean":"2023-11-24T07:57:43.529124+0000","last_became_active":"2023-11-24T07:57:43.522410+0000","last_became_peered":"2023-11-24T07:57:43.522410+0000","last_unstale":"2023-11-24T07:57:43.529124+0000","last_undegraded":"2023-11-24T07:57:43.529124+0000","last_fullsized":"2023-11-24T07:57:43.529124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:26.414972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506596+0000","last_change":"2023-11-24T07:57:43.533557+0000","last_active":"2023-11-24T07:57:44.506596+0000","last_peered":"2023-11-24T07:57:44.506596+0000","last_clean":"2023-11-24T07:57:44.506596+0000","last_became_active":"2023-11-24T07:57:43.533228+0000","last_became_peered":"2023-11-24T07:57:43.533228+0000","last_unstale":"2023-11-24T07:57:44.506596+0000","last_undegraded":"2023-11-24T07:57:44.506596+0000","last_fullsized":"2023-11-24T07:57:44.506596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:33.328342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507290+0000","last_change":"2023-11-24T07:57:43.532469+0000","last_active":"2023-11-24T07:57:44.507290+0000","last_peered":"2023-11-24T07:57:44.507290+0000","last_clean":"2023-11-24T07:57:44.507290+0000","last_became_active":"2023-11-24T07:57:43.531595+0000","last_became_peered":"2023-11-24T07:57:43.531595+0000","last_unstale":"2023-11-24T07:57:44.507290+0000","last_undegraded":"2023-11-24T07:57:44.507290+0000","last_fullsized":"2023-11-24T07:57:44.507290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:25.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506353+0000","last_change":"2023-11-24T07:57:43.529030+0000","last_active":"2023-11-24T07:57:44.506353+0000","last_peered":"2023-11-24T07:57:44.506353+0000","last_clean":"2023-11-24T07:57:44.506353+0000","last_became_active":"2023-11-24T07:57:43.528649+0000","last_became_peered":"2023-11-24T07:57:43.528649+0000","last_unstale":"2023-11-24T07:57:44.506353+0000","last_undegraded":"2023-11-24T07:57:44.506353+0000","last_fullsized":"2023-11-24T07:57:44.506353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:42.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506102+0000","last_change":"2023-11-24T07:57:43.531416+0000","last_active":"2023-11-24T07:57:44.506102+0000","last_peered":"2023-11-24T07:57:44.506102+0000","last_clean":"2023-11-24T07:57:44.506102+0000","last_became_active":"2023-11-24T07:57:43.531158+0000","last_became_peered":"2023-11-24T07:57:43.531158+0000","last_unstale":"2023-11-24T07:57:44.506102+0000","last_undegraded":"2023-11-24T07:57:44.506102+0000","last_fullsized":"2023-11-24T07:57:44.506102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:04:35.428721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525075+0000","last_change":"2023-11-24T07:57:43.523319+0000","last_active":"2023-11-24T07:57:43.525075+0000","last_peered":"2023-11-24T07:57:43.525075+0000","last_clean":"2023-11-24T07:57:43.525075+0000","last_became_active":"2023-11-24T07:57:43.522923+0000","last_became_peered":"2023-11-24T07:57:43.522923+0000","last_unstale":"2023-11-24T07:57:43.525075+0000","last_undegraded":"2023-11-24T07:57:43.525075+0000","last_fullsized":"2023-11-24T07:57:43.525075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:40.653639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523925+0000","last_change":"2023-11-24T07:57:43.519091+0000","last_active":"2023-11-24T07:57:43.523925+0000","last_peered":"2023-11-24T07:57:43.523925+0000","last_clean":"2023-11-24T07:57:43.523925+0000","last_became_active":"2023-11-24T07:57:43.517936+0000","last_became_peered":"2023-11-24T07:57:43.517936+0000","last_unstale":"2023-11-24T07:57:43.523925+0000","last_undegraded":"2023-11-24T07:57:43.523925+0000","last_fullsized":"2023-11-24T07:57:43.523925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:19:14.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.540616+0000","last_change":"2023-11-24T07:57:43.537690+0000","last_active":"2023-11-24T07:57:43.540616+0000","last_peered":"2023-11-24T07:57:43.540616+0000","last_clean":"2023-11-24T07:57:43.540616+0000","last_became_active":"2023-11-24T07:57:43.537382+0000","last_became_peered":"2023-11-24T07:57:43.537382+0000","last_unstale":"2023-11-24T07:57:43.540616+0000","last_undegraded":"2023-11-24T07:57:43.540616+0000","last_fullsized":"2023-11-24T07:57:43.540616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:11.412465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719526+0000","last_change":"2023-11-24T07:57:43.536198+0000","last_active":"2023-11-24T07:57:45.719526+0000","last_peered":"2023-11-24T07:57:45.719526+0000","last_clean":"2023-11-24T07:57:45.719526+0000","last_became_active":"2023-11-24T07:57:43.535903+0000","last_became_peered":"2023-11-24T07:57:43.535903+0000","last_unstale":"2023-11-24T07:57:45.719526+0000","last_undegraded":"2023-11-24T07:57:45.719526+0000","last_fullsized":"2023-11-24T07:57:45.719526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:50.732941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.531609+0000","last_change":"2023-11-24T07:57:43.523758+0000","last_active":"2023-11-24T07:57:43.531609+0000","last_peered":"2023-11-24T07:57:43.531609+0000","last_clean":"2023-11-24T07:57:43.531609+0000","last_became_active":"2023-11-24T07:57:43.523476+0000","last_became_peered":"2023-11-24T07:57:43.523476+0000","last_unstale":"2023-11-24T07:57:43.531609+0000","last_undegraded":"2023-11-24T07:57:43.531609+0000","last_fullsized":"2023-11-24T07:57:43.531609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:29.129442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559638+0000","last_change":"2023-11-24T07:57:43.535284+0000","last_active":"2023-11-24T07:57:44.559638+0000","last_peered":"2023-11-24T07:57:44.559638+0000","last_clean":"2023-11-24T07:57:44.559638+0000","last_became_active":"2023-11-24T07:57:43.534974+0000","last_became_peered":"2023-11-24T07:57:43.534974+0000","last_unstale":"2023-11-24T07:57:44.559638+0000","last_undegraded":"2023-11-24T07:57:44.559638+0000","last_fullsized":"2023-11-24T07:57:44.559638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:09.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506505+0000","last_change":"2023-11-24T07:57:43.538331+0000","last_active":"2023-11-24T07:57:44.506505+0000","last_peered":"2023-11-24T07:57:44.506505+0000","last_clean":"2023-11-24T07:57:44.506505+0000","last_became_active":"2023-11-24T07:57:43.537928+0000","last_became_peered":"2023-11-24T07:57:43.537928+0000","last_unstale":"2023-11-24T07:57:44.506505+0000","last_undegraded":"2023-11-24T07:57:44.506505+0000","last_fullsized":"2023-11-24T07:57:44.506505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:29.506550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559518+0000","last_change":"2023-11-24T07:57:43.521319+0000","last_active":"2023-11-24T07:57:44.559518+0000","last_peered":"2023-11-24T07:57:44.559518+0000","last_clean":"2023-11-24T07:57:44.559518+0000","last_became_active":"2023-11-24T07:57:43.520870+0000","last_became_peered":"2023-11-24T07:57:43.520870+0000","last_unstale":"2023-11-24T07:57:44.559518+0000","last_undegraded":"2023-11-24T07:57:44.559518+0000","last_fullsized":"2023-11-24T07:57:44.559518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:23.209329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523748+0000","last_change":"2023-11-24T07:57:43.517888+0000","last_active":"2023-11-24T07:57:43.523748+0000","last_peered":"2023-11-24T07:57:43.523748+0000","last_clean":"2023-11-24T07:57:43.523748+0000","last_became_active":"2023-11-24T07:57:43.517593+0000","last_became_peered":"2023-11-24T07:57:43.517593+0000","last_unstale":"2023-11-24T07:57:43.523748+0000","last_undegraded":"2023-11-24T07:57:43.523748+0000","last_fullsized":"2023-11-24T07:57:43.523748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.541282+0000","last_change":"2023-11-24T07:57:43.538164+0000","last_active":"2023-11-24T07:57:43.541282+0000","last_peered":"2023-11-24T07:57:43.541282+0000","last_clean":"2023-11-24T07:57:43.541282+0000","last_became_active":"2023-11-24T07:57:43.537653+0000","last_became_peered":"2023-11-24T07:57:43.537653+0000","last_unstale":"2023-11-24T07:57:43.541282+0000","last_undegraded":"2023-11-24T07:57:43.541282+0000","last_fullsized":"2023-11-24T07:57:43.541282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:55.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506556+0000","last_change":"2023-11-24T07:57:43.534723+0000","last_active":"2023-11-24T07:57:44.506556+0000","last_peered":"2023-11-24T07:57:44.506556+0000","last_clean":"2023-11-24T07:57:44.506556+0000","last_became_active":"2023-11-24T07:57:43.534393+0000","last_became_peered":"2023-11-24T07:57:43.534393+0000","last_unstale":"2023-11-24T07:57:44.506556+0000","last_undegraded":"2023-11-24T07:57:44.506556+0000","last_fullsized":"2023-11-24T07:57:44.506556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:09.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506430+0000","last_change":"2023-11-24T07:57:43.525653+0000","last_active":"2023-11-24T07:57:44.506430+0000","last_peered":"2023-11-24T07:57:44.506430+0000","last_clean":"2023-11-24T07:57:44.506430+0000","last_became_active":"2023-11-24T07:57:43.525020+0000","last_became_peered":"2023-11-24T07:57:43.525020+0000","last_unstale":"2023-11-24T07:57:44.506430+0000","last_undegraded":"2023-11-24T07:57:44.506430+0000","last_fullsized":"2023-11-24T07:57:44.506430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506454+0000","last_change":"2023-11-24T07:57:43.532846+0000","last_active":"2023-11-24T07:57:44.506454+0000","last_peered":"2023-11-24T07:57:44.506454+0000","last_clean":"2023-11-24T07:57:44.506454+0000","last_became_active":"2023-11-24T07:57:43.531162+0000","last_became_peered":"2023-11-24T07:57:43.531162+0000","last_unstale":"2023-11-24T07:57:44.506454+0000","last_undegraded":"2023-11-24T07:57:44.506454+0000","last_fullsized":"2023-11-24T07:57:44.506454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:23.209329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719649+0000","last_change":"2023-11-24T07:57:43.535452+0000","last_active":"2023-11-24T07:57:45.719649+0000","last_peered":"2023-11-24T07:57:45.719649+0000","last_clean":"2023-11-24T07:57:45.719649+0000","last_became_active":"2023-11-24T07:57:43.535160+0000","last_became_peered":"2023-11-24T07:57:43.535160+0000","last_unstale":"2023-11-24T07:57:45.719649+0000","last_undegraded":"2023-11-24T07:57:45.719649+0000","last_fullsized":"2023-11-24T07:57:45.719649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.507036+0000","last_change":"2023-11-24T07:57:42.518937+0000","last_active":"2023-11-24T07:57:44.507036+0000","last_peered":"2023-11-24T07:57:44.507036+0000","last_clean":"2023-11-24T07:57:44.507036+0000","last_became_active":"2023-11-24T07:57:42.518708+0000","last_became_peered":"2023-11-24T07:57:42.518708+0000","last_unstale":"2023-11-24T07:57:44.507036+0000","last_undegraded":"2023-11-24T07:57:44.507036+0000","last_fullsized":"2023-11-24T07:57:44.507036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506943+0000","last_change":"2023-11-24T07:57:43.526044+0000","last_active":"2023-11-24T07:57:44.506943+0000","last_peered":"2023-11-24T07:57:44.506943+0000","last_clean":"2023-11-24T07:57:44.506943+0000","last_became_active":"2023-11-24T07:57:43.525784+0000","last_became_peered":"2023-11-24T07:57:43.525784+0000","last_unstale":"2023-11-24T07:57:44.506943+0000","last_undegraded":"2023-11-24T07:57:44.506943+0000","last_fullsized":"2023-11-24T07:57:44.506943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:43.934399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719695+0000","last_change":"2023-11-24T07:57:42.510132+0000","last_active":"2023-11-24T07:57:45.719695+0000","last_peered":"2023-11-24T07:57:45.719695+0000","last_clean":"2023-11-24T07:57:45.719695+0000","last_became_active":"2023-11-24T07:57:42.509824+0000","last_became_peered":"2023-11-24T07:57:42.509824+0000","last_unstale":"2023-11-24T07:57:45.719695+0000","last_undegraded":"2023-11-24T07:57:45.719695+0000","last_fullsized":"2023-11-24T07:57:45.719695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.540756+0000","last_change":"2023-11-24T07:57:43.537923+0000","last_active":"2023-11-24T07:57:43.540756+0000","last_peered":"2023-11-24T07:57:43.540756+0000","last_clean":"2023-11-24T07:57:43.540756+0000","last_became_active":"2023-11-24T07:57:43.537632+0000","last_became_peered":"2023-11-24T07:57:43.537632+0000","last_unstale":"2023-11-24T07:57:43.540756+0000","last_undegraded":"2023-11-24T07:57:43.540756+0000","last_fullsized":"2023-11-24T07:57:43.540756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:41:07.289890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506092+0000","last_change":"2023-11-24T07:57:42.521734+0000","last_active":"2023-11-24T07:57:44.506092+0000","last_peered":"2023-11-24T07:57:44.506092+0000","last_clean":"2023-11-24T07:57:44.506092+0000","last_became_active":"2023-11-24T07:57:42.521036+0000","last_became_peered":"2023-11-24T07:57:42.521036+0000","last_unstale":"2023-11-24T07:57:44.506092+0000","last_undegraded":"2023-11-24T07:57:44.506092+0000","last_fullsized":"2023-11-24T07:57:44.506092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:16.061389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559576+0000","last_change":"2023-11-24T07:57:43.521140+0000","last_active":"2023-11-24T07:57:44.559576+0000","last_peered":"2023-11-24T07:57:44.559576+0000","last_clean":"2023-11-24T07:57:44.559576+0000","last_became_active":"2023-11-24T07:57:43.520510+0000","last_became_peered":"2023-11-24T07:57:43.520510+0000","last_unstale":"2023-11-24T07:57:44.559576+0000","last_undegraded":"2023-11-24T07:57:44.559576+0000","last_fullsized":"2023-11-24T07:57:44.559576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:50.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553228+0000","last_change":"2023-11-24T07:57:42.516005+0000","last_active":"2023-11-24T07:57:43.553228+0000","last_peered":"2023-11-24T07:57:43.553228+0000","last_clean":"2023-11-24T07:57:43.553228+0000","last_became_active":"2023-11-24T07:57:42.515583+0000","last_became_peered":"2023-11-24T07:57:42.515583+0000","last_unstale":"2023-11-24T07:57:43.553228+0000","last_undegraded":"2023-11-24T07:57:43.553228+0000","last_fullsized":"2023-11-24T07:57:43.553228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:41:06.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506985+0000","last_change":"2023-11-24T07:57:43.535064+0000","last_active":"2023-11-24T07:57:44.506985+0000","last_peered":"2023-11-24T07:57:44.506985+0000","last_clean":"2023-11-24T07:57:44.506985+0000","last_became_active":"2023-11-24T07:57:43.531634+0000","last_became_peered":"2023-11-24T07:57:43.531634+0000","last_unstale":"2023-11-24T07:57:44.506985+0000","last_undegraded":"2023-11-24T07:57:44.506985+0000","last_fullsized":"2023-11-24T07:57:44.506985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:49.548283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.550942+0000","last_change":"2023-11-24T07:57:42.509431+0000","last_active":"2023-11-24T07:57:43.550942+0000","last_peered":"2023-11-24T07:57:43.550942+0000","last_clean":"2023-11-24T07:57:43.550942+0000","last_became_active":"2023-11-24T07:57:42.507260+0000","last_became_peered":"2023-11-24T07:57:42.507260+0000","last_unstale":"2023-11-24T07:57:43.550942+0000","last_undegraded":"2023-11-24T07:57:43.550942+0000","last_fullsized":"2023-11-24T07:57:43.550942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.527520+0000","last_change":"2023-11-24T07:57:43.519494+0000","last_active":"2023-11-24T07:57:43.527520+0000","last_peered":"2023-11-24T07:57:43.527520+0000","last_clean":"2023-11-24T07:57:43.527520+0000","last_became_active":"2023-11-24T07:57:43.519209+0000","last_became_peered":"2023-11-24T07:57:43.519209+0000","last_unstale":"2023-11-24T07:57:43.527520+0000","last_undegraded":"2023-11-24T07:57:43.527520+0000","last_fullsized":"2023-11-24T07:57:43.527520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:35:21.240503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.550233+0000","last_change":"2023-11-24T07:57:42.507811+0000","last_active":"2023-11-24T07:57:43.550233+0000","last_peered":"2023-11-24T07:57:43.550233+0000","last_clean":"2023-11-24T07:57:43.550233+0000","last_became_active":"2023-11-24T07:57:42.507335+0000","last_became_peered":"2023-11-24T07:57:42.507335+0000","last_unstale":"2023-11-24T07:57:43.550233+0000","last_undegraded":"2023-11-24T07:57:43.550233+0000","last_fullsized":"2023-11-24T07:57:43.550233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:48:36.032820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.530163+0000","last_change":"2023-11-24T07:57:43.523756+0000","last_active":"2023-11-24T07:57:43.530163+0000","last_peered":"2023-11-24T07:57:43.530163+0000","last_clean":"2023-11-24T07:57:43.530163+0000","last_became_active":"2023-11-24T07:57:43.522391+0000","last_became_peered":"2023-11-24T07:57:43.522391+0000","last_unstale":"2023-11-24T07:57:43.530163+0000","last_undegraded":"2023-11-24T07:57:43.530163+0000","last_fullsized":"2023-11-24T07:57:43.530163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:54:49.412872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505583+0000","last_change":"2023-11-24T07:57:42.513841+0000","last_active":"2023-11-24T07:57:44.505583+0000","last_peered":"2023-11-24T07:57:44.505583+0000","last_clean":"2023-11-24T07:57:44.505583+0000","last_became_active":"2023-11-24T07:57:42.513533+0000","last_became_peered":"2023-11-24T07:57:42.513533+0000","last_unstale":"2023-11-24T07:57:44.505583+0000","last_undegraded":"2023-11-24T07:57:44.505583+0000","last_fullsized":"2023-11-24T07:57:44.505583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:08.206684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.558951+0000","last_change":"2023-11-24T07:57:43.527956+0000","last_active":"2023-11-24T07:57:44.558951+0000","last_peered":"2023-11-24T07:57:44.558951+0000","last_clean":"2023-11-24T07:57:44.558951+0000","last_became_active":"2023-11-24T07:57:43.527688+0000","last_became_peered":"2023-11-24T07:57:43.527688+0000","last_unstale":"2023-11-24T07:57:44.558951+0000","last_undegraded":"2023-11-24T07:57:44.558951+0000","last_fullsized":"2023-11-24T07:57:44.558951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:39.205186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.510406+0000","last_change":"2023-11-24T07:57:42.509142+0000","last_active":"2023-11-24T07:57:43.510406+0000","last_peered":"2023-11-24T07:57:43.510406+0000","last_clean":"2023-11-24T07:57:43.510406+0000","last_became_active":"2023-11-24T07:57:42.508818+0000","last_became_peered":"2023-11-24T07:57:42.508818+0000","last_unstale":"2023-11-24T07:57:43.510406+0000","last_undegraded":"2023-11-24T07:57:43.510406+0000","last_fullsized":"2023-11-24T07:57:43.510406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:51.591397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.534178+0000","last_change":"2023-11-24T07:57:43.531337+0000","last_active":"2023-11-24T07:57:43.534178+0000","last_peered":"2023-11-24T07:57:43.534178+0000","last_clean":"2023-11-24T07:57:43.534178+0000","last_became_active":"2023-11-24T07:57:43.531046+0000","last_became_peered":"2023-11-24T07:57:43.531046+0000","last_unstale":"2023-11-24T07:57:43.534178+0000","last_undegraded":"2023-11-24T07:57:43.534178+0000","last_fullsized":"2023-11-24T07:57:43.534178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:46.238920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506182+0000","last_change":"2023-11-24T07:57:42.520891+0000","last_active":"2023-11-24T07:57:44.506182+0000","last_peered":"2023-11-24T07:57:44.506182+0000","last_clean":"2023-11-24T07:57:44.506182+0000","last_became_active":"2023-11-24T07:57:42.520635+0000","last_became_peered":"2023-11-24T07:57:42.520635+0000","last_unstale":"2023-11-24T07:57:44.506182+0000","last_undegraded":"2023-11-24T07:57:44.506182+0000","last_fullsized":"2023-11-24T07:57:44.506182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:25.435977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506103+0000","last_change":"2023-11-24T07:57:43.527797+0000","last_active":"2023-11-24T07:57:44.506103+0000","last_peered":"2023-11-24T07:57:44.506103+0000","last_clean":"2023-11-24T07:57:44.506103+0000","last_became_active":"2023-11-24T07:57:43.527198+0000","last_became_peered":"2023-11-24T07:57:43.527198+0000","last_unstale":"2023-11-24T07:57:44.506103+0000","last_undegraded":"2023-11-24T07:57:44.506103+0000","last_fullsized":"2023-11-24T07:57:44.506103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:44.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719816+0000","last_change":"2023-11-24T07:57:42.521194+0000","last_active":"2023-11-24T07:57:45.719816+0000","last_peered":"2023-11-24T07:57:45.719816+0000","last_clean":"2023-11-24T07:57:45.719816+0000","last_became_active":"2023-11-24T07:57:42.520881+0000","last_became_peered":"2023-11-24T07:57:42.520881+0000","last_unstale":"2023-11-24T07:57:45.719816+0000","last_undegraded":"2023-11-24T07:57:45.719816+0000","last_fullsized":"2023-11-24T07:57:45.719816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506223+0000","last_change":"2023-11-24T07:57:43.538717+0000","last_active":"2023-11-24T07:57:44.506223+0000","last_peered":"2023-11-24T07:57:44.506223+0000","last_clean":"2023-11-24T07:57:44.506223+0000","last_became_active":"2023-11-24T07:57:43.538334+0000","last_became_peered":"2023-11-24T07:57:43.538334+0000","last_unstale":"2023-11-24T07:57:44.506223+0000","last_undegraded":"2023-11-24T07:57:44.506223+0000","last_fullsized":"2023-11-24T07:57:44.506223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:19.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.551203+0000","last_change":"2023-11-24T07:57:42.505000+0000","last_active":"2023-11-24T07:57:43.551203+0000","last_peered":"2023-11-24T07:57:43.551203+0000","last_clean":"2023-11-24T07:57:43.551203+0000","last_became_active":"2023-11-24T07:57:42.504484+0000","last_became_peered":"2023-11-24T07:57:42.504484+0000","last_unstale":"2023-11-24T07:57:43.551203+0000","last_undegraded":"2023-11-24T07:57:43.551203+0000","last_fullsized":"2023-11-24T07:57:43.551203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:42.928403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.529040+0000","last_change":"2023-11-24T07:57:43.522679+0000","last_active":"2023-11-24T07:57:43.529040+0000","last_peered":"2023-11-24T07:57:43.529040+0000","last_clean":"2023-11-24T07:57:43.529040+0000","last_became_active":"2023-11-24T07:57:43.522008+0000","last_became_peered":"2023-11-24T07:57:43.522008+0000","last_unstale":"2023-11-24T07:57:43.529040+0000","last_undegraded":"2023-11-24T07:57:43.529040+0000","last_fullsized":"2023-11-24T07:57:43.529040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506086+0000","last_change":"2023-11-24T07:57:42.520083+0000","last_active":"2023-11-24T07:57:44.506086+0000","last_peered":"2023-11-24T07:57:44.506086+0000","last_clean":"2023-11-24T07:57:44.506086+0000","last_became_active":"2023-11-24T07:57:42.519759+0000","last_became_peered":"2023-11-24T07:57:42.519759+0000","last_unstale":"2023-11-24T07:57:44.506086+0000","last_undegraded":"2023-11-24T07:57:44.506086+0000","last_fullsized":"2023-11-24T07:57:44.506086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:29:32.322346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559043+0000","last_change":"2023-11-24T07:57:43.527594+0000","last_active":"2023-11-24T07:57:44.559043+0000","last_peered":"2023-11-24T07:57:44.559043+0000","last_clean":"2023-11-24T07:57:44.559043+0000","last_became_active":"2023-11-24T07:57:43.527288+0000","last_became_peered":"2023-11-24T07:57:43.527288+0000","last_unstale":"2023-11-24T07:57:44.559043+0000","last_undegraded":"2023-11-24T07:57:44.559043+0000","last_fullsized":"2023-11-24T07:57:44.559043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:46.238920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553761+0000","last_change":"2023-11-24T07:57:42.510077+0000","last_active":"2023-11-24T07:57:43.553761+0000","last_peered":"2023-11-24T07:57:43.553761+0000","last_clean":"2023-11-24T07:57:43.553761+0000","last_became_active":"2023-11-24T07:57:42.509783+0000","last_became_peered":"2023-11-24T07:57:42.509783+0000","last_unstale":"2023-11-24T07:57:43.553761+0000","last_undegraded":"2023-11-24T07:57:43.553761+0000","last_fullsized":"2023-11-24T07:57:43.553761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505763+0000","last_change":"2023-11-24T07:57:43.524573+0000","last_active":"2023-11-24T07:57:44.505763+0000","last_peered":"2023-11-24T07:57:44.505763+0000","last_clean":"2023-11-24T07:57:44.505763+0000","last_became_active":"2023-11-24T07:57:43.524228+0000","last_became_peered":"2023-11-24T07:57:43.524228+0000","last_unstale":"2023-11-24T07:57:44.505763+0000","last_undegraded":"2023-11-24T07:57:44.505763+0000","last_fullsized":"2023-11-24T07:57:44.505763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:26:55.369553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.558960+0000","last_change":"2023-11-24T07:57:42.517296+0000","last_active":"2023-11-24T07:57:44.558960+0000","last_peered":"2023-11-24T07:57:44.558960+0000","last_clean":"2023-11-24T07:57:44.558960+0000","last_became_active":"2023-11-24T07:57:42.516844+0000","last_became_peered":"2023-11-24T07:57:42.516844+0000","last_unstale":"2023-11-24T07:57:44.558960+0000","last_undegraded":"2023-11-24T07:57:44.558960+0000","last_fullsized":"2023-11-24T07:57:44.558960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:27.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506551+0000","last_change":"2023-11-24T07:57:43.533751+0000","last_active":"2023-11-24T07:57:44.506551+0000","last_peered":"2023-11-24T07:57:44.506551+0000","last_clean":"2023-11-24T07:57:44.506551+0000","last_became_active":"2023-11-24T07:57:43.533273+0000","last_became_peered":"2023-11-24T07:57:43.533273+0000","last_unstale":"2023-11-24T07:57:44.506551+0000","last_undegraded":"2023-11-24T07:57:44.506551+0000","last_fullsized":"2023-11-24T07:57:44.506551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:50.154028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505473+0000","last_change":"2023-11-24T07:57:42.512341+0000","last_active":"2023-11-24T07:57:44.505473+0000","last_peered":"2023-11-24T07:57:44.505473+0000","last_clean":"2023-11-24T07:57:44.505473+0000","last_became_active":"2023-11-24T07:57:42.510737+0000","last_became_peered":"2023-11-24T07:57:42.510737+0000","last_unstale":"2023-11-24T07:57:44.505473+0000","last_undegraded":"2023-11-24T07:57:44.505473+0000","last_fullsized":"2023-11-24T07:57:44.505473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:49.148032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506187+0000","last_change":"2023-11-24T07:57:43.526634+0000","last_active":"2023-11-24T07:57:44.506187+0000","last_peered":"2023-11-24T07:57:44.506187+0000","last_clean":"2023-11-24T07:57:44.506187+0000","last_became_active":"2023-11-24T07:57:43.526373+0000","last_became_peered":"2023-11-24T07:57:43.526373+0000","last_unstale":"2023-11-24T07:57:44.506187+0000","last_undegraded":"2023-11-24T07:57:44.506187+0000","last_fullsized":"2023-11-24T07:57:44.506187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:50.732941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505610+0000","last_change":"2023-11-24T07:57:42.522278+0000","last_active":"2023-11-24T07:57:44.505610+0000","last_peered":"2023-11-24T07:57:44.505610+0000","last_clean":"2023-11-24T07:57:44.505610+0000","last_became_active":"2023-11-24T07:57:42.519817+0000","last_became_peered":"2023-11-24T07:57:42.519817+0000","last_unstale":"2023-11-24T07:57:44.505610+0000","last_undegraded":"2023-11-24T07:57:44.505610+0000","last_fullsized":"2023-11-24T07:57:44.505610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:22.203333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523820+0000","last_change":"2023-11-24T07:57:43.518462+0000","last_active":"2023-11-24T07:57:43.523820+0000","last_peered":"2023-11-24T07:57:43.523820+0000","last_clean":"2023-11-24T07:57:43.523820+0000","last_became_active":"2023-11-24T07:57:43.518116+0000","last_became_peered":"2023-11-24T07:57:43.518116+0000","last_unstale":"2023-11-24T07:57:43.523820+0000","last_undegraded":"2023-11-24T07:57:43.523820+0000","last_fullsized":"2023-11-24T07:57:43.523820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:59.714178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559683+0000","last_change":"2023-11-24T07:57:42.524067+0000","last_active":"2023-11-24T07:57:44.559683+0000","last_peered":"2023-11-24T07:57:44.559683+0000","last_clean":"2023-11-24T07:57:44.559683+0000","last_became_active":"2023-11-24T07:57:42.523783+0000","last_became_peered":"2023-11-24T07:57:42.523783+0000","last_unstale":"2023-11-24T07:57:44.559683+0000","last_undegraded":"2023-11-24T07:57:44.559683+0000","last_fullsized":"2023-11-24T07:57:44.559683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:02.730087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.532605+0000","last_change":"2023-11-24T07:57:43.525961+0000","last_active":"2023-11-24T07:57:43.532605+0000","last_peered":"2023-11-24T07:57:43.532605+0000","last_clean":"2023-11-24T07:57:43.532605+0000","last_became_active":"2023-11-24T07:57:43.521932+0000","last_became_peered":"2023-11-24T07:57:43.521932+0000","last_unstale":"2023-11-24T07:57:43.532605+0000","last_undegraded":"2023-11-24T07:57:43.532605+0000","last_fullsized":"2023-11-24T07:57:43.532605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:41.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.553667+0000","last_change":"2023-11-24T07:57:42.510192+0000","last_active":"2023-11-24T07:57:43.553667+0000","last_peered":"2023-11-24T07:57:43.553667+0000","last_clean":"2023-11-24T07:57:43.553667+0000","last_became_active":"2023-11-24T07:57:42.509870+0000","last_became_peered":"2023-11-24T07:57:42.509870+0000","last_unstale":"2023-11-24T07:57:43.553667+0000","last_undegraded":"2023-11-24T07:57:43.553667+0000","last_fullsized":"2023-11-24T07:57:43.553667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:39.208072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559343+0000","last_change":"2023-11-24T07:57:43.522209+0000","last_active":"2023-11-24T07:57:44.559343+0000","last_peered":"2023-11-24T07:57:44.559343+0000","last_clean":"2023-11-24T07:57:44.559343+0000","last_became_active":"2023-11-24T07:57:43.521893+0000","last_became_peered":"2023-11-24T07:57:43.521893+0000","last_unstale":"2023-11-24T07:57:44.559343+0000","last_undegraded":"2023-11-24T07:57:44.559343+0000","last_fullsized":"2023-11-24T07:57:44.559343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:41.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.551136+0000","last_change":"2023-11-24T07:57:42.508655+0000","last_active":"2023-11-24T07:57:43.551136+0000","last_peered":"2023-11-24T07:57:43.551136+0000","last_clean":"2023-11-24T07:57:43.551136+0000","last_became_active":"2023-11-24T07:57:42.508338+0000","last_became_peered":"2023-11-24T07:57:42.508338+0000","last_unstale":"2023-11-24T07:57:43.551136+0000","last_undegraded":"2023-11-24T07:57:43.551136+0000","last_fullsized":"2023-11-24T07:57:43.551136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:50.313833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.536628+0000","last_change":"2023-11-24T07:57:43.535093+0000","last_active":"2023-11-24T07:57:43.536628+0000","last_peered":"2023-11-24T07:57:43.536628+0000","last_clean":"2023-11-24T07:57:43.536628+0000","last_became_active":"2023-11-24T07:57:43.534770+0000","last_became_peered":"2023-11-24T07:57:43.534770+0000","last_unstale":"2023-11-24T07:57:43.536628+0000","last_undegraded":"2023-11-24T07:57:43.536628+0000","last_fullsized":"2023-11-24T07:57:43.536628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:59.714178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.507025+0000","last_change":"2023-11-24T07:57:42.514769+0000","last_active":"2023-11-24T07:57:43.507025+0000","last_peered":"2023-11-24T07:57:43.507025+0000","last_clean":"2023-11-24T07:57:43.507025+0000","last_became_active":"2023-11-24T07:57:42.514472+0000","last_became_peered":"2023-11-24T07:57:42.514472+0000","last_unstale":"2023-11-24T07:57:43.507025+0000","last_undegraded":"2023-11-24T07:57:43.507025+0000","last_fullsized":"2023-11-24T07:57:43.507025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:08.392246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.522574+0000","last_change":"2023-11-24T07:57:43.516678+0000","last_active":"2023-11-24T07:57:43.522574+0000","last_peered":"2023-11-24T07:57:43.522574+0000","last_clean":"2023-11-24T07:57:43.522574+0000","last_became_active":"2023-11-24T07:57:43.516379+0000","last_became_peered":"2023-11-24T07:57:43.516379+0000","last_unstale":"2023-11-24T07:57:43.522574+0000","last_undegraded":"2023-11-24T07:57:43.522574+0000","last_fullsized":"2023-11-24T07:57:43.522574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:44:50.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719872+0000","last_change":"2023-11-24T07:57:42.515029+0000","last_active":"2023-11-24T07:57:45.719872+0000","last_peered":"2023-11-24T07:57:45.719872+0000","last_clean":"2023-11-24T07:57:45.719872+0000","last_became_active":"2023-11-24T07:57:42.514747+0000","last_became_peered":"2023-11-24T07:57:42.514747+0000","last_unstale":"2023-11-24T07:57:45.719872+0000","last_undegraded":"2023-11-24T07:57:45.719872+0000","last_fullsized":"2023-11-24T07:57:45.719872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:51.591397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525023+0000","last_change":"2023-11-24T07:57:43.520097+0000","last_active":"2023-11-24T07:57:43.525023+0000","last_peered":"2023-11-24T07:57:43.525023+0000","last_clean":"2023-11-24T07:57:43.525023+0000","last_became_active":"2023-11-24T07:57:43.519803+0000","last_became_peered":"2023-11-24T07:57:43.519803+0000","last_unstale":"2023-11-24T07:57:43.525023+0000","last_undegraded":"2023-11-24T07:57:43.525023+0000","last_fullsized":"2023-11-24T07:57:43.525023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:02:52.603918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506352+0000","last_change":"2023-11-24T07:57:42.517859+0000","last_active":"2023-11-24T07:57:44.506352+0000","last_peered":"2023-11-24T07:57:44.506352+0000","last_clean":"2023-11-24T07:57:44.506352+0000","last_became_active":"2023-11-24T07:57:42.517080+0000","last_became_peered":"2023-11-24T07:57:42.517080+0000","last_unstale":"2023-11-24T07:57:44.506352+0000","last_undegraded":"2023-11-24T07:57:44.506352+0000","last_fullsized":"2023-11-24T07:57:44.506352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.523814+0000","last_change":"2023-11-24T07:57:43.517039+0000","last_active":"2023-11-24T07:57:43.523814+0000","last_peered":"2023-11-24T07:57:43.523814+0000","last_clean":"2023-11-24T07:57:43.523814+0000","last_became_active":"2023-11-24T07:57:43.516761+0000","last_became_peered":"2023-11-24T07:57:43.516761+0000","last_unstale":"2023-11-24T07:57:43.523814+0000","last_undegraded":"2023-11-24T07:57:43.523814+0000","last_fullsized":"2023-11-24T07:57:43.523814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:49.043173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.509971+0000","last_change":"2023-11-24T07:57:42.512097+0000","last_active":"2023-11-24T07:57:43.509971+0000","last_peered":"2023-11-24T07:57:43.509971+0000","last_clean":"2023-11-24T07:57:43.509971+0000","last_became_active":"2023-11-24T07:57:42.511754+0000","last_became_peered":"2023-11-24T07:57:42.511754+0000","last_unstale":"2023-11-24T07:57:43.509971+0000","last_undegraded":"2023-11-24T07:57:43.509971+0000","last_fullsized":"2023-11-24T07:57:43.509971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:28:35.261475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506935+0000","last_change":"2023-11-24T07:57:43.534606+0000","last_active":"2023-11-24T07:57:44.506935+0000","last_peered":"2023-11-24T07:57:44.506935+0000","last_clean":"2023-11-24T07:57:44.506935+0000","last_became_active":"2023-11-24T07:57:43.531913+0000","last_became_peered":"2023-11-24T07:57:43.531913+0000","last_unstale":"2023-11-24T07:57:44.506935+0000","last_undegraded":"2023-11-24T07:57:44.506935+0000","last_fullsized":"2023-11-24T07:57:44.506935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:26.441973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.506582+0000","last_change":"2023-11-24T07:57:42.509431+0000","last_active":"2023-11-24T07:57:43.506582+0000","last_peered":"2023-11-24T07:57:43.506582+0000","last_clean":"2023-11-24T07:57:43.506582+0000","last_became_active":"2023-11-24T07:57:42.509107+0000","last_became_peered":"2023-11-24T07:57:42.509107+0000","last_unstale":"2023-11-24T07:57:43.506582+0000","last_undegraded":"2023-11-24T07:57:43.506582+0000","last_fullsized":"2023-11-24T07:57:43.506582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:49.726945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.525794+0000","last_change":"2023-11-24T07:57:43.523334+0000","last_active":"2023-11-24T07:57:43.525794+0000","last_peered":"2023-11-24T07:57:43.525794+0000","last_clean":"2023-11-24T07:57:43.525794+0000","last_became_active":"2023-11-24T07:57:43.522949+0000","last_became_peered":"2023-11-24T07:57:43.522949+0000","last_unstale":"2023-11-24T07:57:43.525794+0000","last_undegraded":"2023-11-24T07:57:43.525794+0000","last_fullsized":"2023-11-24T07:57:43.525794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:09.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559727+0000","last_change":"2023-11-24T07:57:42.522223+0000","last_active":"2023-11-24T07:57:44.559727+0000","last_peered":"2023-11-24T07:57:44.559727+0000","last_clean":"2023-11-24T07:57:44.559727+0000","last_became_active":"2023-11-24T07:57:42.521543+0000","last_became_peered":"2023-11-24T07:57:42.521543+0000","last_unstale":"2023-11-24T07:57:44.559727+0000","last_undegraded":"2023-11-24T07:57:44.559727+0000","last_fullsized":"2023-11-24T07:57:44.559727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:26:42.928403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.528889+0000","last_change":"2023-11-24T07:57:43.521064+0000","last_active":"2023-11-24T07:57:43.528889+0000","last_peered":"2023-11-24T07:57:43.528889+0000","last_clean":"2023-11-24T07:57:43.528889+0000","last_became_active":"2023-11-24T07:57:43.520767+0000","last_became_peered":"2023-11-24T07:57:43.520767+0000","last_unstale":"2023-11-24T07:57:43.528889+0000","last_undegraded":"2023-11-24T07:57:43.528889+0000","last_fullsized":"2023-11-24T07:57:43.528889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:16.651061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.721370+0000","last_change":"2023-11-24T07:57:42.515847+0000","last_active":"2023-11-24T07:57:45.721370+0000","last_peered":"2023-11-24T07:57:45.721370+0000","last_clean":"2023-11-24T07:57:45.721370+0000","last_became_active":"2023-11-24T07:57:42.515511+0000","last_became_peered":"2023-11-24T07:57:42.515511+0000","last_unstale":"2023-11-24T07:57:45.721370+0000","last_undegraded":"2023-11-24T07:57:45.721370+0000","last_fullsized":"2023-11-24T07:57:45.721370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:25.408976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719584+0000","last_change":"2023-11-24T07:57:43.517823+0000","last_active":"2023-11-24T07:57:45.719584+0000","last_peered":"2023-11-24T07:57:45.719584+0000","last_clean":"2023-11-24T07:57:45.719584+0000","last_became_active":"2023-11-24T07:57:43.516270+0000","last_became_peered":"2023-11-24T07:57:43.516270+0000","last_unstale":"2023-11-24T07:57:45.719584+0000","last_undegraded":"2023-11-24T07:57:45.719584+0000","last_fullsized":"2023-11-24T07:57:45.719584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:28.640260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559442+0000","last_change":"2023-11-24T07:57:42.513011+0000","last_active":"2023-11-24T07:57:44.559442+0000","last_peered":"2023-11-24T07:57:44.559442+0000","last_clean":"2023-11-24T07:57:44.559442+0000","last_became_active":"2023-11-24T07:57:42.512711+0000","last_became_peered":"2023-11-24T07:57:42.512711+0000","last_unstale":"2023-11-24T07:57:44.559442+0000","last_undegraded":"2023-11-24T07:57:44.559442+0000","last_fullsized":"2023-11-24T07:57:44.559442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:49.726945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506261+0000","last_change":"2023-11-24T07:57:43.529658+0000","last_active":"2023-11-24T07:57:44.506261+0000","last_peered":"2023-11-24T07:57:44.506261+0000","last_clean":"2023-11-24T07:57:44.506261+0000","last_became_active":"2023-11-24T07:57:43.529325+0000","last_became_peered":"2023-11-24T07:57:43.529325+0000","last_unstale":"2023-11-24T07:57:44.506261+0000","last_undegraded":"2023-11-24T07:57:44.506261+0000","last_fullsized":"2023-11-24T07:57:44.506261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:03.736083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719933+0000","last_change":"2023-11-24T07:57:42.513813+0000","last_active":"2023-11-24T07:57:45.719933+0000","last_peered":"2023-11-24T07:57:45.719933+0000","last_clean":"2023-11-24T07:57:45.719933+0000","last_became_active":"2023-11-24T07:57:42.513452+0000","last_became_peered":"2023-11-24T07:57:42.513452+0000","last_unstale":"2023-11-24T07:57:45.719933+0000","last_undegraded":"2023-11-24T07:57:45.719933+0000","last_fullsized":"2023-11-24T07:57:45.719933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:53.208056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:45.719854+0000","last_change":"2023-11-24T07:57:43.530343+0000","last_active":"2023-11-24T07:57:45.719854+0000","last_peered":"2023-11-24T07:57:45.719854+0000","last_clean":"2023-11-24T07:57:45.719854+0000","last_became_active":"2023-11-24T07:57:43.530031+0000","last_became_peered":"2023-11-24T07:57:43.530031+0000","last_unstale":"2023-11-24T07:57:45.719854+0000","last_undegraded":"2023-11-24T07:57:45.719854+0000","last_fullsized":"2023-11-24T07:57:45.719854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:16.487856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.559013+0000","last_change":"2023-11-24T07:57:42.522901+0000","last_active":"2023-11-24T07:57:44.559013+0000","last_peered":"2023-11-24T07:57:44.559013+0000","last_clean":"2023-11-24T07:57:44.559013+0000","last_became_active":"2023-11-24T07:57:42.521862+0000","last_became_peered":"2023-11-24T07:57:42.521862+0000","last_unstale":"2023-11-24T07:57:44.559013+0000","last_undegraded":"2023-11-24T07:57:44.559013+0000","last_fullsized":"2023-11-24T07:57:44.559013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:15.481860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505518+0000","last_change":"2023-11-24T07:57:43.526811+0000","last_active":"2023-11-24T07:57:44.505518+0000","last_peered":"2023-11-24T07:57:44.505518+0000","last_clean":"2023-11-24T07:57:44.505518+0000","last_became_active":"2023-11-24T07:57:43.526565+0000","last_became_peered":"2023-11-24T07:57:43.526565+0000","last_unstale":"2023-11-24T07:57:44.505518+0000","last_undegraded":"2023-11-24T07:57:44.505518+0000","last_fullsized":"2023-11-24T07:57:44.505518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:31.057524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.509970+0000","last_change":"2023-11-24T07:57:42.502280+0000","last_active":"2023-11-24T07:57:43.509970+0000","last_peered":"2023-11-24T07:57:43.509970+0000","last_clean":"2023-11-24T07:57:43.509970+0000","last_became_active":"2023-11-24T07:57:42.501833+0000","last_became_peered":"2023-11-24T07:57:42.501833+0000","last_unstale":"2023-11-24T07:57:43.509970+0000","last_undegraded":"2023-11-24T07:57:43.509970+0000","last_fullsized":"2023-11-24T07:57:43.509970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:27:30.507547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.541287+0000","last_change":"2023-11-24T07:57:43.538145+0000","last_active":"2023-11-24T07:57:43.541287+0000","last_peered":"2023-11-24T07:57:43.541287+0000","last_clean":"2023-11-24T07:57:43.541287+0000","last_became_active":"2023-11-24T07:57:43.537685+0000","last_became_peered":"2023-11-24T07:57:43.537685+0000","last_unstale":"2023-11-24T07:57:43.541287+0000","last_undegraded":"2023-11-24T07:57:43.541287+0000","last_fullsized":"2023-11-24T07:57:43.541287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:28.365343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.505524+0000","last_change":"2023-11-24T07:57:42.510968+0000","last_active":"2023-11-24T07:57:44.505524+0000","last_peered":"2023-11-24T07:57:44.505524+0000","last_clean":"2023-11-24T07:57:44.505524+0000","last_became_active":"2023-11-24T07:57:42.510626+0000","last_became_peered":"2023-11-24T07:57:42.510626+0000","last_unstale":"2023-11-24T07:57:44.505524+0000","last_undegraded":"2023-11-24T07:57:44.505524+0000","last_fullsized":"2023-11-24T07:57:44.505524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:00:43.401699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506925+0000","last_change":"2023-11-24T07:57:43.532363+0000","last_active":"2023-11-24T07:57:44.506925+0000","last_peered":"2023-11-24T07:57:44.506925+0000","last_clean":"2023-11-24T07:57:44.506925+0000","last_became_active":"2023-11-24T07:57:43.532080+0000","last_became_peered":"2023-11-24T07:57:43.532080+0000","last_unstale":"2023-11-24T07:57:44.506925+0000","last_undegraded":"2023-11-24T07:57:44.506925+0000","last_fullsized":"2023-11-24T07:57:44.506925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:42.484885+0000","last_clean_scrub_stamp":"2023-11-24T07:57:42.484885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:17.067385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T07:57:44.506091+0000","last_change":"2023-11-24T07:57:42.515327+0000","last_active":"2023-11-24T07:57:44.506091+0000","last_peered":"2023-11-24T07:57:44.506091+0000","last_clean":"2023-11-24T07:57:44.506091+0000","last_became_active":"2023-11-24T07:57:42.515049+0000","last_became_peered":"2023-11-24T07:57:42.515049+0000","last_unstale":"2023-11-24T07:57:44.506091+0000","last_undegraded":"2023-11-24T07:57:44.506091+0000","last_fullsized":"2023-11-24T07:57:44.506091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:57:41.478889+0000","last_clean_scrub_stamp":"2023-11-24T07:57:41.478889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:04:28.123446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T07:57:43.516052+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:57:43.516052+0000","last_peered":"2023-11-24T07:57:43.516052+0000","last_clean":"2023-11-24T07:57:43.516052+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:57:43.516052+0000","last_undegraded":"2023-11-24T07:57:43.516052+0000","last_fullsized":"2023-11-24T07:57:43.516052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.442},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.83599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.752}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.872}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.499}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":153533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.82799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":144650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.877},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":152514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.877}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":741248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68700000000000006}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:57:48.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T07:57:48.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T07:57:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 Processor -- start 2023-11-24T07:57:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 -- start start 2023-11-24T07:57:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f505806e3f0 0x7f505815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5058159630 con 0x7f50580ce5d0 2023-11-24T07:57:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505815f6d0 con 0x7f50580cb9b0 2023-11-24T07:57:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505ce5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505806e860 con 0x7f505806e3f0 2023-11-24T07:57:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f505806e3f0 0x7f505815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f505806e3f0 0x7f505815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52892/0 (socket says 172.21.15.5:52892) 2023-11-24T07:57:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 -- 172.21.15.5:0/698665620 learned_addr learned my addr 172.21.15.5:0/698665620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5056d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f50580ce5d0 0x7f505815bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42318/0 (socket says 172.21.15.5:42318) 2023-11-24T07:57:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 -- 172.21.15.5:0/698665620 >> v1:172.21.15.102:6789/0 conn(0x7f50580cb9b0 legacy=0x7f50580cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 -- 172.21.15.5:0/698665620 >> v1:172.21.15.5:6789/0 conn(0x7f50580ce5d0 legacy=0x7f505815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f5055d9b640 1 -- 172.21.15.5:0/698665620 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580cd1d0 con 0x7f505806e3f0 2023-11-24T07:57:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.201+0000 7f505559a640 1 -- 172.21.15.5:0/698665620 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624067393 0 0) 0x7f5058159630 con 0x7f50580ce5d0 2023-11-24T07:57:48.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f5055d9b640 1 --2- 172.21.15.5:0/698665620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f505815f190 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f504c009870 tx=0x7f504c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a6cd18452e4254 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505559a640 1 -- 172.21.15.5:0/698665620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0ab600 con 0x7f505806e3f0 2023-11-24T07:57:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505559a640 1 -- 172.21.15.5:0/698665620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c0a7050 con 0x7f505806e3f0 2023-11-24T07:57:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505559a640 1 -- 172.21.15.5:0/698665620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0ab980 con 0x7f505806e3f0 2023-11-24T07:57:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 -- 172.21.15.5:0/698665620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 msgr2=0x7f505815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 --2- 172.21.15.5:0/698665620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f505815f190 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f504c009870 tx=0x7f504c01c540 comp rx=0 tx=0).stop 2023-11-24T07:57:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 -- 172.21.15.5:0/698665620 shutdown_connections 2023-11-24T07:57:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 --2- 172.21.15.5:0/698665620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f505815f190 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 -- 172.21.15.5:0/698665620 >> 172.21.15.5:0/698665620 conn(0x7f50580b0cb0 msgr2=0x7f50580b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 -- 172.21.15.5:0/698665620 shutdown_connections 2023-11-24T07:57:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.205+0000 7f505ce5a640 1 -- 172.21.15.5:0/698665620 wait complete. 2023-11-24T07:57:48.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 Processor -- start 2023-11-24T07:57:48.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- start start 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50580cb9b0 0x7f5058154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50580ce5d0 0x7f505814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50581551a0 con 0x7f505806e3f0 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505815b620 con 0x7f50580cb9b0 2023-11-24T07:57:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505814df60 con 0x7f50580ce5d0 2023-11-24T07:57:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52896/0 (socket says 172.21.15.5:52896) 2023-11-24T07:57:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 -- 172.21.15.5:0/2900476093 learned_addr learned my addr 172.21.15.5:0/2900476093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f5055d9b640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50580cb9b0 0x7f5058154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f5056d9d640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50580ce5d0 0x7f505814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 -- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50580ce5d0 msgr2=0x7f505814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50580ce5d0 0x7f505814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 -- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50580cb9b0 msgr2=0x7f5058154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50580cb9b0 0x7f5058154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 -- 172.21.15.5:0/2900476093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0094d0 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505659c640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f504800c500 tx=0x7f504800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048005220 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048005380 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048007270 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50581525a0 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5058152b60 con 0x7f505806e3f0 2023-11-24T07:57:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.209+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50580671f0 con 0x7f505806e3f0 2023-11-24T07:57:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.213+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50480073d0 con 0x7f505806e3f0 2023-11-24T07:57:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.213+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 0x7f5038068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.213+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5048083660 con 0x7f505806e3f0 2023-11-24T07:57:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.213+0000 7f5055d9b640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 0x7f5038068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.213+0000 7f5055d9b640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 0x7f5038068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f50580ae970 tx=0x7f504c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.217+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5048050b00 con 0x7f505806e3f0 2023-11-24T07:57:48.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.429+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f505806b460 con 0x7f505806e3f0 2023-11-24T07:57:48.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.429+0000 7f5046ffd640 1 -- 172.21.15.5:0/2900476093 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5048054120 con 0x7f505806e3f0 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQACV2BlLr0xLhAAi9XusKKnaV2O6GgqSb1tVQ== 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T07:57:48.433 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 msgr2=0x7f5038068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 0x7f5038068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f50580ae970 tx=0x7f504c0a6000 comp rx=0 tx=0).stop 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 msgr2=0x7f5058153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f504800c500 tx=0x7f504800c9c0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 shutdown_connections 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f50380664a0 0x7f5038068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50580ce5d0 0x7f505814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50580cb9b0 0x7f5058154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 --2- 172.21.15.5:0/2900476093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f505806e3f0 0x7f5058153360 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 >> 172.21.15.5:0/2900476093 conn(0x7f50580b0cb0 msgr2=0x7f505815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 shutdown_connections 2023-11-24T07:57:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.433+0000 7f505ce5a640 1 -- 172.21.15.5:0/2900476093 wait complete. 2023-11-24T07:57:48.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 Processor -- start 2023-11-24T07:57:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 -- start start 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefd815d880 0x7fefd80b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd80d3e70 0x7fefd80cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80d15f0 con 0x7fefd80b6c70 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80ce000 con 0x7fefd815d880 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefdef62640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80d0630 con 0x7fefd80d3e70 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefd815d880 0x7fefd80b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefd815d880 0x7fefd80b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52910/0 (socket says 172.21.15.5:52910) 2023-11-24T07:57:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 -- 172.21.15.5:0/3453755808 learned_addr learned my addr 172.21.15.5:0/3453755808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefde761640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd80d3e70 0x7fefd80cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 -- 172.21.15.5:0/3453755808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd80d3e70 msgr2=0x7fefd80cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd80d3e70 0x7fefd80cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 -- 172.21.15.5:0/3453755808 >> v1:172.21.15.102:6789/0 conn(0x7fefd80b6c70 legacy=0x7fefd80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.597+0000 7fefddf60640 1 -- 172.21.15.5:0/3453755808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80d0910 con 0x7fefd815d880 2023-11-24T07:57:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefddf60640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd815d880 0x7fefd80b6730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f3f68a85b0d9ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdcf5e640 1 -- 172.21.15.5:0/3453755808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a9620 con 0x7fefd815d880 2023-11-24T07:57:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdcf5e640 1 -- 172.21.15.5:0/3453755808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40a9780 con 0x7fefd815d880 2023-11-24T07:57:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdcf5e640 1 -- 172.21.15.5:0/3453755808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a9b10 con 0x7fefd815d880 2023-11-24T07:57:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 -- 172.21.15.5:0/3453755808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd815d880 msgr2=0x7fefd80b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd815d880 0x7fefd80b6730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009870 tx=0x7fefd401c540 comp rx=0 tx=0).stop 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 -- 172.21.15.5:0/3453755808 shutdown_connections 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd80d3e70 0x7fefd80cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 --2- 172.21.15.5:0/3453755808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd815d880 0x7fefd80b6730 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 -- 172.21.15.5:0/3453755808 >> 172.21.15.5:0/3453755808 conn(0x7fefd806b9f0 msgr2=0x7fefd806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 -- 172.21.15.5:0/3453755808 shutdown_connections 2023-11-24T07:57:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.601+0000 7fefdef62640 1 -- 172.21.15.5:0/3453755808 wait complete. 2023-11-24T07:57:48.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 Processor -- start 2023-11-24T07:57:48.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- start start 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefd80b6c70 0x7fefd80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd815d880 0x7fefd8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8155ff0 con 0x7fefd80d3e70 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8156b70 con 0x7fefd80b6c70 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8156240 con 0x7fefd815d880 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52918/0 (socket says 172.21.15.5:52918) 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 -- 172.21.15.5:0/2285751600 learned_addr learned my addr 172.21.15.5:0/2285751600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefddf60640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefd80b6c70 0x7fefd80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefde761640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd815d880 0x7fefd8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 -- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd815d880 msgr2=0x7fefd8150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd815d880 0x7fefd8150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 -- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefd80b6c70 msgr2=0x7fefd80b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefd80b6c70 0x7fefd80b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 -- 172.21.15.5:0/2285751600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40094d0 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdd75f640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c530 tx=0x7fefc800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8005220 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8005380 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8007270 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8156520 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.605+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8151a30 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd8074a00 con 0x7fefd80d3e70 2023-11-24T07:57:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefc80073d0 con 0x7fefd80d3e70 2023-11-24T07:57:48.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefce7fc640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:48.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefc80836f0 con 0x7fefd80d3e70 2023-11-24T07:57:48.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefddf60640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:48.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.609+0000 7fefddf60640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 0x7fefbc068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefd40ae000 tx=0x7fefd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:48.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.613+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefc8050b80 con 0x7fefd80d3e70 2023-11-24T07:57:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.801+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd80d11a0 con 0x7fefd80d3e70 2023-11-24T07:57:48.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.801+0000 7fefce7fc640 1 -- 172.21.15.5:0/2285751600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fefc80541a0 con 0x7fefd80d3e70 2023-11-24T07:57:48.805 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:48.805 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:57:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 msgr2=0x7fefbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 0x7fefbc068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefd40ae000 tx=0x7fefd4009040 comp rx=0 tx=0).stop 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 msgr2=0x7fefd8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c530 tx=0x7fefc800c9f0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 shutdown_connections 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefd815d880 0x7fefd8150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd80d3e70 0x7fefd8157000 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 --2- 172.21.15.5:0/2285751600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefd80b6c70 0x7fefd80b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 >> 172.21.15.5:0/2285751600 conn(0x7fefd806b9f0 msgr2=0x7fefd815f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 shutdown_connections 2023-11-24T07:57:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:48.805+0000 7fefdef62640 1 -- 172.21.15.5:0/2285751600 wait complete. 2023-11-24T07:57:49.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T07:57:42.886645+0000', 'modified': '2023-11-24T07:57:45.915498+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5091': {'gid': 5091, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1586527042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1586527042}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1586527042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T07:57:49.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T07:57:49.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-24T07:57:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.373+0000 7f1361193640 1 Processor -- start 2023-11-24T07:57:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.373+0000 7f1361193640 1 -- start start 2023-11-24T07:57:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1361193640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f135c13f8f0 0x7f135c06c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1361193640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f135c06c790 0x7f135c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1361193640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c1406c0 con 0x7f135c13cf80 2023-11-24T07:57:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1361193640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c06cc20 con 0x7f135c06c790 2023-11-24T07:57:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1361193640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c15dd20 con 0x7f135c13f8f0 2023-11-24T07:57:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f135bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f135c13cf80 0x7f135c13ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2023-11-24T07:57:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f135bfff640 1 -- 172.21.15.5:0/2241297853 learned_addr learned my addr 172.21.15.5:0/2241297853 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1360992640 1 --2- 172.21.15.5:0/2241297853 >> v2:172.21.15.5:3300/0 conn(0x7f135c06c790 0x7f135c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f135b7fe640 1 --2- 172.21.15.5:0/2241297853 >> v2:172.21.15.102:3300/0 conn(0x7f135c13f8f0 0x7f135c06c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f135affd640 1 -- 172.21.15.5:0/2241297853 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152797025 0 0) 0x7f135c1406c0 con 0x7f135c13cf80 2023-11-24T07:57:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f135affd640 1 -- 172.21.15.5:0/2241297853 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1344005740 con 0x7f135c13cf80 2023-11-24T07:57:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1360992640 1 -- 172.21.15.5:0/2241297853 >> v2:172.21.15.102:3300/0 conn(0x7f135c13f8f0 msgr2=0x7f135c06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1360992640 1 --2- 172.21.15.5:0/2241297853 >> v2:172.21.15.102:3300/0 conn(0x7f135c13f8f0 0x7f135c06c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1360992640 1 -- 172.21.15.5:0/2241297853 >> v1:172.21.15.5:6789/0 conn(0x7f135c13cf80 legacy=0x7f135c13ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.377+0000 7f1360992640 1 -- 172.21.15.5:0/2241297853 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c15e000 con 0x7f135c06c790 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1360992640 1 --2- 172.21.15.5:0/2241297853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c0cd750 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f135c0b41b0 tx=0x7f135401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf018402fd2d21d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f135affd640 1 -- 172.21.15.5:0/2241297853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540a5890 con 0x7f135c06c790 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f135affd640 1 -- 172.21.15.5:0/2241297853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540a59f0 con 0x7f135c06c790 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f135affd640 1 -- 172.21.15.5:0/2241297853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540a5d80 con 0x7f135c06c790 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- 172.21.15.5:0/2241297853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 msgr2=0x7f135c0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 --2- 172.21.15.5:0/2241297853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c0cd750 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f135c0b41b0 tx=0x7f135401c850 comp rx=0 tx=0).stop 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- 172.21.15.5:0/2241297853 shutdown_connections 2023-11-24T07:57:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 --2- 172.21.15.5:0/2241297853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c0cd750 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 --2- 172.21.15.5:0/2241297853 >> v2:172.21.15.102:3300/0 conn(0x7f135c13f8f0 0x7f135c06c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- 172.21.15.5:0/2241297853 >> 172.21.15.5:0/2241297853 conn(0x7f135c06df30 msgr2=0x7f135c06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- 172.21.15.5:0/2241297853 shutdown_connections 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- 172.21.15.5:0/2241297853 wait complete. 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 Processor -- start 2023-11-24T07:57:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.381+0000 7f1361193640 1 -- start start 2023-11-24T07:57:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c13cf80 0x7f135c13c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 0x7f135c1f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c139b40 con 0x7f135c06c790 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c1504a0 con 0x7f135c13cf80 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c139d50 con 0x7f135c13f8f0 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52928/0 (socket says 172.21.15.5:52928) 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 -- 172.21.15.5:0/36553155 learned_addr learned my addr 172.21.15.5:0/36553155 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135b7fe640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c13cf80 0x7f135c13c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1360992640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 0x7f135c1f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 -- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 msgr2=0x7f135c1f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 0x7f135c1f9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 -- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c13cf80 msgr2=0x7f135c13c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c13cf80 0x7f135c13c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 -- 172.21.15.5:0/36553155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009a70 con 0x7f135c06c790 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1360992640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 0x7f135c1f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f135bfff640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c4d0 tx=0x7f134c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1358ff9640 1 -- 172.21.15.5:0/36553155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c005cf0 con 0x7f135c06c790 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1358ff9640 1 -- 172.21.15.5:0/36553155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c005e50 con 0x7f135c06c790 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c150860 con 0x7f135c06c790 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1358ff9640 1 -- 172.21.15.5:0/36553155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c007270 con 0x7f135c06c790 2023-11-24T07:57:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.385+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c13a030 con 0x7f135c06c790 2023-11-24T07:57:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1358ff9640 1 -- 172.21.15.5:0/36553155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f134c0073d0 con 0x7f135c06c790 2023-11-24T07:57:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1358ff9640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 0x7f1348068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1358ff9640 1 -- 172.21.15.5:0/36553155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f134c0833e0 con 0x7f135c06c790 2023-11-24T07:57:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 Processor -- start 2023-11-24T07:57:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135b7fe640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 0x7f1348068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 -- start start 2023-11-24T07:57:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135b7fe640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 0x7f1348068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f135c13c5d0 tx=0x7f1350009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bec1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 0x555e8be76de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bce1130 con 0x555e8be77320 2023-11-24T07:57:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bcce9a0 con 0x555e8bec0c90 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e8bccbed0 con 0x555e8bec15b0 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52944/0 (socket says 172.21.15.5:52944) 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 -- 172.21.15.5:0/3959168830 learned_addr learned my addr 172.21.15.5:0/3959168830 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135b7fe640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 0x555e8be76de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135bfff640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bec1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 -- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 msgr2=0x555e8be76de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 0x555e8be76de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 -- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 msgr2=0x555e8bec1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bec1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 -- 172.21.15.5:0/3959168830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e8b9bf890 con 0x555e8be77320 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135bfff640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bec1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f135b7fe640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 0x555e8be76de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.389+0000 7f1360992640 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f135401a480 tx=0x7f1354004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ee96f81c3b3df4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f1341ffb640 1 -- 172.21.15.5:0/3959168830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540a5890 con 0x555e8be77320 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f1341ffb640 1 -- 172.21.15.5:0/3959168830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540a5d60 con 0x555e8be77320 2023-11-24T07:57:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f1341ffb640 1 -- 172.21.15.5:0/3959168830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540b86a0 con 0x555e8be77320 2023-11-24T07:57:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- 172.21.15.5:0/3959168830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 msgr2=0x555e8be77700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f135401a480 tx=0x7f1354004ac0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- 172.21.15.5:0/3959168830 shutdown_connections 2023-11-24T07:57:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be77700 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec15b0 0x555e8be76de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- 172.21.15.5:0/3959168830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bec1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- 172.21.15.5:0/3959168830 >> 172.21.15.5:0/3959168830 conn(0x555e8be732d0 msgr2=0x555e8be756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- 172.21.15.5:0/3959168830 shutdown_connections 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- 172.21.15.5:0/3959168830 wait complete. 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- start start 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 Processor -- start 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec0c90 0x555e8be7c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec15b0 0x555e8be8f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bcc77c0 con 0x555e8be77320 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bc7fbf0 con 0x555e8bec15b0 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e8bc85a90 con 0x555e8bec0c90 2023-11-24T07:57:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f136575b000 10 client.0 _ll_register_callbacks cb 0x555e8be623c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52956/0 (socket says 172.21.15.5:52956) 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 -- 172.21.15.5:0/2469320086 learned_addr learned my addr 172.21.15.5:0/2469320086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f1360992640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec15b0 0x555e8be8f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135b7fe640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec0c90 0x555e8be7c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 -- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec0c90 msgr2=0x555e8be7c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec0c90 0x555e8be7c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 -- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec15b0 msgr2=0x555e8be8f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec15b0 0x555e8be8f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 -- 172.21.15.5:0/2469320086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c15e000 con 0x555e8be77320 2023-11-24T07:57:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f135bfff640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f134c000f70 tx=0x7f134c058720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9ca0adff7fdd59 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f133affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c052a20 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.393+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f134c053ab0 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e8bc89470 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f134c053c70 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 10 client.5274 fetch_fsmap learned FSMap version 15 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x555e8bc88190 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e8bc89470 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f134c05c380 con 0x555e8be77320 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 10 client.5274 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 10 client.5274 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T07:57:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 20 client.5274 populate_metadata read hostname 'smithi005' 2023-11-24T07:57:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8be90320 0x555e8bed2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 4 client.5274 mds_command: new command op to 5091 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T07:57:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 --> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e8bc8cb50 con 0x555e8be90320 2023-11-24T07:57:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f135b7fe640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8be90320 0x555e8bed2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f135b7fe640 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8be90320 0x555e8bed2f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebdc595cef702ff4 server_cookie=3b6980f82982871 in_seq=0 out_seq=0 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 10 client.5274 ms_handle_connect on v2:172.21.15.5:6834/1586527042 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 1 -- 172.21.15.5:0/2469320086 <== mds.0 v2:172.21.15.5:6834/1586527042 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555e8bc8cb50 con 0x555e8be90320 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 10 client.5274 handle_command_reply: tid=0 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 client.5274 shutdown 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 msgr2=0x555e8be7bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f134c000f70 tx=0x7f134c058720 comp rx=0 tx=0).stop 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 shutdown_connections 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8be90320 0x555e8bed2f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec15b0 0x555e8be8f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8bec0c90 0x555e8be7c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 --2- 172.21.15.5:0/2469320086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8be77320 0x555e8be7bd70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f133affd640 0 client.5274 ms_handle_reset on v2:172.21.15.5:6834/1586527042 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 >> 172.21.15.5:0/2469320086 conn(0x555e8be732d0 msgr2=0x555e8be756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 shutdown_connections 2023-11-24T07:57:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 1 -- 172.21.15.5:0/2469320086 wait complete. 2023-11-24T07:57:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.397+0000 7f136575b000 20 client.5274 trim_cache size 0 max 16384 2023-11-24T07:57:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 Processor -- start 2023-11-24T07:57:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 -- start start 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8bebeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bebf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8b980940 con 0x555e8bec15b0 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bd4efa0 con 0x555e8bec0c90 2023-11-24T07:57:49.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e8bc628a0 con 0x555e8be77320 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52970/0 (socket says 172.21.15.5:52970) 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 -- 172.21.15.5:0/4070469154 learned_addr learned my addr 172.21.15.5:0/4070469154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f135bfff640 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8bebeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f135b7fe640 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bebf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 -- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 msgr2=0x555e8bebeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8bebeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 -- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 msgr2=0x555e8bebf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bebf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.413+0000 7f1360992640 1 -- 172.21.15.5:0/4070469154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e8bc6e490 con 0x555e8bec15b0 2023-11-24T07:57:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f135401af00 tx=0x7f1354009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaf0445e5c8c3e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f13427fc640 1 -- 172.21.15.5:0/4070469154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540a5d60 con 0x555e8bec15b0 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f13427fc640 1 -- 172.21.15.5:0/4070469154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354007080 con 0x555e8bec15b0 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f13427fc640 1 -- 172.21.15.5:0/4070469154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354003bc0 con 0x555e8bec15b0 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- 172.21.15.5:0/4070469154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 msgr2=0x555e8bebf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f135401af00 tx=0x7f1354009750 comp rx=0 tx=0).stop 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- 172.21.15.5:0/4070469154 shutdown_connections 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bebf5b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bebf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- 172.21.15.5:0/4070469154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8bebeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- 172.21.15.5:0/4070469154 >> 172.21.15.5:0/4070469154 conn(0x555e8be732d0 msgr2=0x555e8bece280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- 172.21.15.5:0/4070469154 shutdown_connections 2023-11-24T07:57:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- 172.21.15.5:0/4070469154 wait complete. 2023-11-24T07:57:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- start start 2023-11-24T07:57:49.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 Processor -- start 2023-11-24T07:57:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8be78a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bed3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bcc6650 con 0x555e8bec15b0 2023-11-24T07:57:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e8bcc0d40 con 0x555e8bec0c90 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e8bc912e0 con 0x555e8be77320 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f136575b000 10 client.0 _ll_register_callbacks cb 0x555e8bd15c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52984/0 (socket says 172.21.15.5:52984) 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 -- 172.21.15.5:0/2751905344 learned_addr learned my addr 172.21.15.5:0/2751905344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f135b7fe640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bed3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f135bfff640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8be78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 -- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 msgr2=0x555e8be78a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8be78a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 -- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 msgr2=0x555e8bed3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bed3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 -- 172.21.15.5:0/2751905344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e8b9bf890 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f1360992640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1354098430 tx=0x7f13540a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4170151ec5360009 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.417+0000 7f133affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540b8740 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13540b88a0 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e8bcc6110 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13540b8a60 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 10 client.5280 fetch_fsmap learned FSMap version 15 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x555e8b9bfcc0 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e8bcc6110 con 0x555e8bec15b0 2023-11-24T07:57:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f13540b8bc0 con 0x555e8bec15b0 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 10 client.5280 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 10 client.5280 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 20 client.5280 populate_metadata read hostname 'smithi005' 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8bf26e30 0x555e8bf29220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 4 client.5280 mds_command: new command op to 5091 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 --> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555e8bcf59a0 con 0x555e8bf26e30 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f135bfff640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8bf26e30 0x555e8bf29220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 10 client.5280 ms_handle_connect on v2:172.21.15.5:6834/1586527042 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f135bfff640 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8bf26e30 0x555e8bf29220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebfd081d324ef395 server_cookie=46771a1f50ccb8d6 in_seq=0 out_seq=0 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 1 -- 172.21.15.5:0/2751905344 <== mds.0 v2:172.21.15.5:6834/1586527042 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555e8bcf59a0 con 0x555e8bf26e30 2023-11-24T07:57:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 10 client.5280 handle_command_reply: tid=0 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 client.5280 shutdown 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 msgr2=0x555e8bed44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1354098430 tx=0x7f13540a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 shutdown_connections 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:6834/1586527042,v1:172.21.15.5:6835/1586527042] conn(0x555e8bf26e30 0x555e8bf29220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555e8bec15b0 0x555e8bed44e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e8bec0c90 0x555e8bed3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f133affd640 0 client.5280 ms_handle_reset on v2:172.21.15.5:6834/1586527042 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 --2- 172.21.15.5:0/2751905344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x555e8be77320 0x555e8be78a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 >> 172.21.15.5:0/2751905344 conn(0x555e8be732d0 msgr2=0x555e8be756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 shutdown_connections 2023-11-24T07:57:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 1 -- 172.21.15.5:0/2751905344 wait complete. 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f136575b000 20 client.5280 trim_cache size 0 max 16384 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c1c5da79-7f10-46d9-a2ce-04e64f4e6baf", 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5091, 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9049379389999999, 2023-11-24T07:57:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 15, 2023-11-24T07:57:49.430 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 34, 2023-11-24T07:57:49.430 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 34, 2023-11-24T07:57:49.430 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.709919162 2023-11-24T07:57:49.430 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:57:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 msgr2=0x7f1348068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 0x7f1348068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f135c13c5d0 tx=0x7f1350009190 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 msgr2=0x7f135c159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c4d0 tx=0x7f134c00c990 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 shutdown_connections 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1348066470 0x7f1348068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f135c13f8f0 0x7f135c1f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c13cf80 0x7f135c13c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 --2- 172.21.15.5:0/36553155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135c06c790 0x7f135c159890 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 >> 172.21.15.5:0/36553155 conn(0x7f135c06df30 msgr2=0x7f135c154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 shutdown_connections 2023-11-24T07:57:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.421+0000 7f1361193640 1 -- 172.21.15.5:0/36553155 wait complete. 2023-11-24T07:57:49.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.585+0000 7f0d0970e640 1 Processor -- start 2023-11-24T07:57:49.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.585+0000 7f0d0970e640 1 -- start start 2023-11-24T07:57:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d0970e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d040ac630 0x7f0d040706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d0970e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d04070c20 0x7f0d0406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d0970e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d04145060 con 0x7f0d04144c80 2023-11-24T07:57:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d0970e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d04071fd0 con 0x7f0d040ac630 2023-11-24T07:57:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d0970e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d04071450 con 0x7f0d04070c20 2023-11-24T07:57:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d040ac630 0x7f0d040706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d037fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d04070c20 0x7f0d0406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d040ac630 0x7f0d040706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52996/0 (socket says 172.21.15.5:52996) 2023-11-24T07:57:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d02ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0d04144c80 0x7f0d040abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:45574/0 (socket says 172.21.15.5:45574) 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 -- 172.21.15.5:0/1940021306 learned_addr learned my addr 172.21.15.5:0/1940021306 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 -- 172.21.15.5:0/1940021306 >> v2:172.21.15.102:3300/0 conn(0x7f0d04070c20 msgr2=0x7f0d0406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 --2- 172.21.15.5:0/1940021306 >> v2:172.21.15.102:3300/0 conn(0x7f0d04070c20 0x7f0d0406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 -- 172.21.15.5:0/1940021306 >> v1:172.21.15.102:6789/0 conn(0x7f0d04144c80 legacy=0x7f0d040abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0cfbfff640 1 -- 172.21.15.5:0/1940021306 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04071730 con 0x7f0d040ac630 2023-11-24T07:57:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.589+0000 7f0d027fc640 1 -- 172.21.15.5:0/1940021306 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351248470 0 0) 0x7f0d04145060 con 0x7f0d04144c80 2023-11-24T07:57:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0cfbfff640 1 --2- 172.21.15.5:0/1940021306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040706e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d040ce840 tx=0x7f0cec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e6dbdf634256f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d027fc640 1 -- 172.21.15.5:0/1940021306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0aa430 con 0x7f0d040ac630 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d027fc640 1 -- 172.21.15.5:0/1940021306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0aa590 con 0x7f0d040ac630 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d027fc640 1 -- 172.21.15.5:0/1940021306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0aa920 con 0x7f0d040ac630 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- 172.21.15.5:0/1940021306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 msgr2=0x7f0d040706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 --2- 172.21.15.5:0/1940021306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040706e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d040ce840 tx=0x7f0cec01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- 172.21.15.5:0/1940021306 shutdown_connections 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 --2- 172.21.15.5:0/1940021306 >> v2:172.21.15.102:3300/0 conn(0x7f0d04070c20 0x7f0d0406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 --2- 172.21.15.5:0/1940021306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040706e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- 172.21.15.5:0/1940021306 >> 172.21.15.5:0/1940021306 conn(0x7f0d040b0c40 msgr2=0x7f0d040b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- 172.21.15.5:0/1940021306 shutdown_connections 2023-11-24T07:57:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- 172.21.15.5:0/1940021306 wait complete. 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 Processor -- start 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.593+0000 7f0d0970e640 1 -- start start 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d04070c20 0x7f0d04142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 0x7f0d040b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d041439a0 con 0x7f0d040ac630 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04143c80 con 0x7f0d04070c20 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04143f60 con 0x7f0d04144c80 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53006/0 (socket says 172.21.15.5:53006) 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 -- 172.21.15.5:0/3642394043 learned_addr learned my addr 172.21.15.5:0/3642394043 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d02ffd640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d04070c20 0x7f0d04142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d037fe640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 0x7f0d040b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 -- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 msgr2=0x7f0d040b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 0x7f0d040b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 -- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d04070c20 msgr2=0x7f0d04142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d04070c20 0x7f0d04142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 -- 172.21.15.5:0/3642394043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094d0 con 0x7f0d040ac630 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d037fe640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 0x7f0d040b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfbfff640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cec01ab80 tx=0x7f0cec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0aac90 con 0x7f0d040ac630 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0b7070 con 0x7f0d040ac630 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d04144240 con 0x7f0d040ac630 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec004020 con 0x7f0d040ac630 2023-11-24T07:57:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040cd7f0 con 0x7f0d040ac630 2023-11-24T07:57:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d040b1ba0 con 0x7f0d040ac630 2023-11-24T07:57:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.597+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cec004180 con 0x7f0d040ac630 2023-11-24T07:57:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.601+0000 7f0cfb7fe640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 0x7f0ce4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.601+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cec11df10 con 0x7f0d040ac630 2023-11-24T07:57:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.601+0000 7f0d02ffd640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 0x7f0ce4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.601+0000 7f0d02ffd640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 0x7f0ce4068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000f70 tx=0x7f0cf4007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.605+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cec0eb380 con 0x7f0d040ac630 2023-11-24T07:57:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d04153500 con 0x7f0d040ac630 2023-11-24T07:57:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0cfb7fe640 1 -- 172.21.15.5:0/3642394043 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d04153500 con 0x7f0d040ac630 2023-11-24T07:57:49.798 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 msgr2=0x7f0ce4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 0x7f0ce4068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000f70 tx=0x7f0cf4007df0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 msgr2=0x7f0d040b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cec01ab80 tx=0x7f0cec01ad10 comp rx=0 tx=0).stop 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 shutdown_connections 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ce4066470 0x7f0ce4068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d04144c80 0x7f0d040b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d040ac630 0x7f0d040b2040 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 --2- 172.21.15.5:0/3642394043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d04070c20 0x7f0d04142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 >> 172.21.15.5:0/3642394043 conn(0x7f0d040b0c40 msgr2=0x7f0d040afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 shutdown_connections 2023-11-24T07:57:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:49.797+0000 7f0d0970e640 1 -- 172.21.15.5:0/3642394043 wait complete. 2023-11-24T07:57:49.819 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T07:57:49.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:49.819 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:49.820 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T07:57:49.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:49.821 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-11-24T07:57:49.831 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:49.831 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:49.831 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:49.831 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.831 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.832 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42363sec preferred_lft 42363sec 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-11-24T07:57:49.833 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:be:f5:01:bf brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.834 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.835 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:49.836 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T07:57:49.836 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T07:57:49.836 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:49.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:49.837 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:49.896 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-11-24T07:57:49.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:49.898 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-11-24T07:57:49.954 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:49.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T07:57:49.956 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-11-24T07:57:50.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.054 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:57:50.063 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T07:57:50.063 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T07:57:50.064 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T07:57:50.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-11-24T07:57:50.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:50.127 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:50.178 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T07:57:50.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:50.178 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:50.229 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:50.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:50.325 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:50.325 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:50.325 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:50.340 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:50.340 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:50.340 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:50.340 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:50.340 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:50.348 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:50.349 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:50.352 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:50.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:50.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.374 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:50.435 INFO:teuthology.orchestra.run.smithi005.stdout:client5170 2023-11-24T07:57:50.435 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:50.435 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:50.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T07:57:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.673+0000 7f17863a1640 1 Processor -- start 2023-11-24T07:57:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.673+0000 7f17863a1640 1 -- start start 2023-11-24T07:57:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f17863a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 0x7f178006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f17863a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f17863a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178006e950 con 0x7f1780143ae0 2023-11-24T07:57:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f17863a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1780070670 con 0x7f17800adcc0 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f17863a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780070950 con 0x7f178006dfd0 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f178493e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 0x7f178006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1780143ae0 0x7f17800b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:45588/0 (socket says 172.21.15.5:45588) 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177ffff640 1 -- 172.21.15.5:0/4199179020 learned_addr learned my addr 172.21.15.5:0/4199179020 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f178493e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:42984/0 (socket says 172.21.15.5:42984) 2023-11-24T07:57:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177f7fe640 1 -- 172.21.15.5:0/4199179020 >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 msgr2=0x7f17800ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177f7fe640 1 --2- 172.21.15.5:0/4199179020 >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177f7fe640 1 -- 172.21.15.5:0/4199179020 >> v1:172.21.15.102:6789/0 conn(0x7f1780143ae0 legacy=0x7f17800b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177f7fe640 1 -- 172.21.15.5:0/4199179020 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780070c30 con 0x7f178006dfd0 2023-11-24T07:57:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f177effd640 1 -- 172.21.15.5:0/4199179020 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030937963 0 0) 0x7f178006e950 con 0x7f1780143ae0 2023-11-24T07:57:50.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.677+0000 7f178493e640 1 --2- 172.21.15.5:0/4199179020 >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f177f7fe640 1 --2- 172.21.15.5:0/4199179020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 0x7f178006e410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17740097c0 tx=0x7f177401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12431cde1f2c468e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f177effd640 1 -- 172.21.15.5:0/4199179020 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740ab650 con 0x7f178006dfd0 2023-11-24T07:57:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f177effd640 1 -- 172.21.15.5:0/4199179020 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740ab7b0 con 0x7f178006dfd0 2023-11-24T07:57:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f177effd640 1 -- 172.21.15.5:0/4199179020 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740abb40 con 0x7f178006dfd0 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- 172.21.15.5:0/4199179020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 msgr2=0x7f178006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- 172.21.15.5:0/4199179020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 0x7f178006e410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17740097c0 tx=0x7f177401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- 172.21.15.5:0/4199179020 shutdown_connections 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- 172.21.15.5:0/4199179020 >> v2:172.21.15.102:3300/0 conn(0x7f17800adcc0 0x7f17800ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- 172.21.15.5:0/4199179020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f178006dfd0 0x7f178006e410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- 172.21.15.5:0/4199179020 >> 172.21.15.5:0/4199179020 conn(0x7f17800b0c40 msgr2=0x7f17800b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- 172.21.15.5:0/4199179020 shutdown_connections 2023-11-24T07:57:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- 172.21.15.5:0/4199179020 wait complete. 2023-11-24T07:57:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 Processor -- start 2023-11-24T07:57:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 -- start start 2023-11-24T07:57:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17800adcc0 0x7f17801f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.681+0000 7f17863a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1780143ae0 0x7f17800b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178013a500 con 0x7f178006dfd0 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178013eb60 con 0x7f17800adcc0 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178013cf60 con 0x7f1780143ae0 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53014/0 (socket says 172.21.15.5:53014) 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 -- 172.21.15.5:0/728646763 learned_addr learned my addr 172.21.15.5:0/728646763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f178493e640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1780143ae0 0x7f17800b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177f7fe640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17800adcc0 0x7f17801f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 -- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1780143ae0 msgr2=0x7f17800b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1780143ae0 0x7f17800b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 -- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17800adcc0 msgr2=0x7f17801f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17800adcc0 0x7f17801f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 -- 172.21.15.5:0/728646763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778009a70 con 0x7f178006dfd0 2023-11-24T07:57:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177ffff640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f177000c480 tx=0x7f177000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700074e0 con 0x7f178006dfd0 2023-11-24T07:57:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770007660 con 0x7f178006dfd0 2023-11-24T07:57:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770004a30 con 0x7f178006dfd0 2023-11-24T07:57:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1774009420 con 0x7f178006dfd0 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178013d450 con 0x7f178006dfd0 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178004e850 con 0x7f178006dfd0 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.685+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1770004b90 con 0x7f178006dfd0 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.689+0000 7f177cff9640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 0x7f176c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.689+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1770083b00 con 0x7f178006dfd0 2023-11-24T07:57:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.689+0000 7f177f7fe640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 0x7f176c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.689+0000 7f177f7fe640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 0x7f176c068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17740af000 tx=0x7f17740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.693+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1770085e60 con 0x7f178006dfd0 2023-11-24T07:57:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f178006cc40 con 0x7f178006dfd0 2023-11-24T07:57:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f177cff9640 1 -- 172.21.15.5:0/728646763 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1770050f70 con 0x7f178006dfd0 2023-11-24T07:57:50.887 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T07:57:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 msgr2=0x7f176c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 0x7f176c068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17740af000 tx=0x7f17740a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 msgr2=0x7f178013ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f177000c480 tx=0x7f177000c880 comp rx=0 tx=0).stop 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 shutdown_connections 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f176c066470 0x7f176c068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1780143ae0 0x7f17800b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17800adcc0 0x7f17801f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 --2- 172.21.15.5:0/728646763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f178006dfd0 0x7f178013ca20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 >> 172.21.15.5:0/728646763 conn(0x7f17800b0c40 msgr2=0x7f17800aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 shutdown_connections 2023-11-24T07:57:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:50.885+0000 7f17863a1640 1 -- 172.21.15.5:0/728646763 wait complete. 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T07:57:50.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T07:57:50.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.909 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-24T07:57:50.920 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T07:57:50.920 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T07:57:50.920 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T07:57:50.920 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-24T07:57:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:50.922 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.922 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-24T07:57:50.922 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T07:57:50.922 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.923 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T07:57:50.923 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.923 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T07:57:50.923 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-11-24T07:57:50.923 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:c2:a0:4d:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T07:57:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T07:57:50.925 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run.smithi102.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-24T07:57:50.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.927 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T07:57:50.982 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-24T07:57:50.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:50.984 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-24T07:57:51.041 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-24T07:57:51.041 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T07:57:51.041 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T07:57:51.041 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T07:57:51.041 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T07:57:51.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.042 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-24T07:57:51.042 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-24T07:57:51.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T07:57:51.043 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T07:57:51.043 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T07:57:51.043 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-24T07:57:51.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.134 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:57:51.143 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T07:57:51.143 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T07:57:51.144 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T07:57:51.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-11-24T07:57:51.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:51.211 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T07:57:51.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T07:57:51.271 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:51.323 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T07:57:51.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:51.416 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:51.416 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:51.416 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:51.431 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:51.431 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:51.431 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:51.431 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:51.431 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.102:3300,172.21.15.102:3301" 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790" 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2023-11-24T07:57:51.441 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c1c5da79-7f10-46d9-a2ce-04e64f4e6baf" will pass to kernel 2023-11-24T07:57:51.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T07:57:51.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:51.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:51.466 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T07:57:51.518 INFO:teuthology.orchestra.run.smithi102.stdout:client5292 2023-11-24T07:57:51.519 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:51.519 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:51.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T07:57:51.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.721+0000 7fa01ddf8640 1 Processor -- start 2023-11-24T07:57:51.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.721+0000 7fa01ddf8640 1 -- start start 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa01ddf8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa01815d8f0 0x7fa01815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa01ddf8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0180ced30 0x7fa0180cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa01ddf8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01815ecc0 con 0x7fa0180cf1b0 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa01ddf8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180d4420 con 0x7fa01815d8f0 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa01ddf8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cdfb0 con 0x7fa0180ced30 2023-11-24T07:57:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0177fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa01815d8f0 0x7fa01815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa017fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0180cf1b0 0x7fa0180d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42340/0 (socket says 172.21.15.5:42340) 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa017fff640 1 -- 172.21.15.5:0/3733764840 learned_addr learned my addr 172.21.15.5:0/3733764840 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa016ffd640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0180ced30 0x7fa0180cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0177fe640 1 -- 172.21.15.5:0/3733764840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0180ced30 msgr2=0x7fa0180cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0177fe640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0180ced30 0x7fa0180cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0177fe640 1 -- 172.21.15.5:0/3733764840 >> v1:172.21.15.5:6789/0 conn(0x7fa0180cf1b0 legacy=0x7fa0180d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0177fe640 1 -- 172.21.15.5:0/3733764840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180d4140 con 0x7fa01815d8f0 2023-11-24T07:57:51.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.725+0000 7fa0167fc640 1 -- 172.21.15.5:0/3733764840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815345725 0 0) 0x7fa01815ecc0 con 0x7fa0180cf1b0 2023-11-24T07:57:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa0177fe640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01815d8f0 0x7fa01815e780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0080097c0 tx=0x7fa00801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4322a703237c1b54 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa0167fc640 1 -- 172.21.15.5:0/3733764840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080ab650 con 0x7fa01815d8f0 2023-11-24T07:57:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa0167fc640 1 -- 172.21.15.5:0/3733764840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080ab7b0 con 0x7fa01815d8f0 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa0167fc640 1 -- 172.21.15.5:0/3733764840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080abb40 con 0x7fa01815d8f0 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- 172.21.15.5:0/3733764840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01815d8f0 msgr2=0x7fa01815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01815d8f0 0x7fa01815e780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0080097c0 tx=0x7fa00801c450 comp rx=0 tx=0).stop 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- 172.21.15.5:0/3733764840 shutdown_connections 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0180ced30 0x7fa0180cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/3733764840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01815d8f0 0x7fa01815e780 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:51.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- 172.21.15.5:0/3733764840 >> 172.21.15.5:0/3733764840 conn(0x7fa01809c750 msgr2=0x7fa0180d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:51.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- 172.21.15.5:0/3733764840 shutdown_connections 2023-11-24T07:57:51.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- 172.21.15.5:0/3733764840 wait complete. 2023-11-24T07:57:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 Processor -- start 2023-11-24T07:57:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.729+0000 7fa01ddf8640 1 -- start start 2023-11-24T07:57:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0180cf1b0 0x7fa0180cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa01815d8f0 0x7fa018156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cc2e0 con 0x7fa0180ced30 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cb6d0 con 0x7fa0180cf1b0 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cb9b0 con 0x7fa01815d8f0 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53020/0 (socket says 172.21.15.5:53020) 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 -- 172.21.15.5:0/1421356561 learned_addr learned my addr 172.21.15.5:0/1421356561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa016ffd640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0180cf1b0 0x7fa0180cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa017fff640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa01815d8f0 0x7fa018156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 -- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa01815d8f0 msgr2=0x7fa018156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa01815d8f0 0x7fa018156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 -- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0180cf1b0 msgr2=0x7fa0180cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0180cf1b0 0x7fa0180cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 -- 172.21.15.5:0/1421356561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009420 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa0177fe640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa00801a080 tx=0x7fa00801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008004220 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080b9070 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008003620 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0180cbc90 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180c9100 con 0x7fa0180ced30 2023-11-24T07:57:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01804e850 con 0x7fa0180ced30 2023-11-24T07:57:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.733+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa008003780 con 0x7fa0180ced30 2023-11-24T07:57:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.737+0000 7f9ffffff640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.737+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0080bb070 con 0x7fa0180ced30 2023-11-24T07:57:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.737+0000 7fa016ffd640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.737+0000 7fa016ffd640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 0x7fa004068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0180cd700 tx=0x7fa00c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.741+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0080ebe70 con 0x7fa0180ced30 2023-11-24T07:57:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:51.933+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa0180d14f0 con 0x7fa0180ced30 2023-11-24T07:57:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.549+0000 7f9ffffff640 1 -- 172.21.15.5:0/1421356561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa0080ef490 con 0x7fa0180ced30 2023-11-24T07:57:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 msgr2=0x7fa004068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 0x7fa004068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0180cd700 tx=0x7fa00c008040 comp rx=0 tx=0).stop 2023-11-24T07:57:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 msgr2=0x7fa0180c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa00801a080 tx=0x7fa00801ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 shutdown_connections 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fa004066470 0x7fa004068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa01815d8f0 0x7fa018156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0180cf1b0 0x7fa0180cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 --2- 172.21.15.5:0/1421356561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ced30 0x7fa0180c8bc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 >> 172.21.15.5:0/1421356561 conn(0x7fa01809c750 msgr2=0x7fa0180b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 shutdown_connections 2023-11-24T07:57:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.553+0000 7fa01ddf8640 1 -- 172.21.15.5:0/1421356561 wait complete. 2023-11-24T07:57:52.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T07:57:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.717+0000 7f85eb172640 1 Processor -- start 2023-11-24T07:57:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.717+0000 7f85eb172640 1 -- start start 2023-11-24T07:57:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85e40b5830 0x7f85e415e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85e40acd70 0x7f85e40ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40ad710 0x7f85e4161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40af630 con 0x7f85e40b5830 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40acb10 con 0x7f85e40acd70 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85eb172640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40adb80 con 0x7f85e40ad710 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85e40b5830 0x7f85e415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85e40b5830 0x7f85e415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53030/0 (socket says 172.21.15.5:53030) 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 -- 172.21.15.5:0/468999181 learned_addr learned my addr 172.21.15.5:0/468999181 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e970f640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40ad710 0x7f85e4161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e3fff640 1 --2- 172.21.15.5:0/468999181 >> v2:172.21.15.102:3300/0 conn(0x7f85e40acd70 0x7f85e40ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 -- 172.21.15.5:0/468999181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40ad710 msgr2=0x7f85e4161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40ad710 0x7f85e4161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 -- 172.21.15.5:0/468999181 >> v2:172.21.15.102:3300/0 conn(0x7f85e40acd70 msgr2=0x7f85e40ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/468999181 >> v2:172.21.15.102:3300/0 conn(0x7f85e40acd70 0x7f85e40ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 -- 172.21.15.5:0/468999181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40ae5b0 con 0x7f85e40b5830 2023-11-24T07:57:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.721+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40b5830 0x7f85e415e690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f85e4070570 tx=0x7f85d801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a1a6e0592237f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e37fe640 1 -- 172.21.15.5:0/468999181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ab600 con 0x7f85e40b5830 2023-11-24T07:57:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e37fe640 1 -- 172.21.15.5:0/468999181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80a7050 con 0x7f85e40b5830 2023-11-24T07:57:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e37fe640 1 -- 172.21.15.5:0/468999181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ab980 con 0x7f85e40b5830 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- 172.21.15.5:0/468999181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40b5830 msgr2=0x7f85e415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40b5830 0x7f85e415e690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f85e4070570 tx=0x7f85d801c240 comp rx=0 tx=0).stop 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- 172.21.15.5:0/468999181 shutdown_connections 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40ad710 0x7f85e4161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- 172.21.15.5:0/468999181 >> v2:172.21.15.102:3300/0 conn(0x7f85e40acd70 0x7f85e40ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- 172.21.15.5:0/468999181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40b5830 0x7f85e415e690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- 172.21.15.5:0/468999181 >> 172.21.15.5:0/468999181 conn(0x7f85e4071d80 msgr2=0x7f85e406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- 172.21.15.5:0/468999181 shutdown_connections 2023-11-24T07:57:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- 172.21.15.5:0/468999181 wait complete. 2023-11-24T07:57:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 Processor -- start 2023-11-24T07:57:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- start start 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 0x7f85e414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40b5830 0x7f85e415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e415cbc0 con 0x7f85e40acd70 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4155930 con 0x7f85e40ad710 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85eb172640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e415ce10 con 0x7f85e40b5830 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e8f0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e8f0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53046/0 (socket says 172.21.15.5:53046) 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.725+0000 7f85e8f0e640 1 -- 172.21.15.5:0/743252121 learned_addr learned my addr 172.21.15.5:0/743252121 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 -- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40b5830 msgr2=0x7f85e415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40b5830 0x7f85e415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e3fff640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 0x7f85e414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 -- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 msgr2=0x7f85e414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 0x7f85e414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 -- 172.21.15.5:0/743252121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d80094d0 con 0x7f85e40acd70 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e3fff640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 0x7f85e414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e8f0e640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ae040 tx=0x7f85d801aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80b6420 con 0x7f85e40acd70 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80a4e90 con 0x7f85e40acd70 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e415d0f0 con 0x7f85e40acd70 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80b67a0 con 0x7f85e40acd70 2023-11-24T07:57:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e41500b0 con 0x7f85e40acd70 2023-11-24T07:57:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e406d110 con 0x7f85e40acd70 2023-11-24T07:57:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85d80b2040 con 0x7f85e40acd70 2023-11-24T07:57:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 0x7f85c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.729+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85d811df40 con 0x7f85e40acd70 2023-11-24T07:57:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.733+0000 7f85e3fff640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 0x7f85c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:52.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.733+0000 7f85e3fff640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 0x7f85c8068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85e41541a0 tx=0x7f85d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.737+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85d80eb440 con 0x7f85e40acd70 2023-11-24T07:57:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.913+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f85e40b5c10 con 0x7f85c8066470 2023-11-24T07:57:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.913+0000 7f85e17fa640 1 -- 172.21.15.5:0/743252121 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f85d0010840 con 0x7f85c8066470 2023-11-24T07:57:52.917 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-11-24T07:57:52.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:57:52.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-11-24T07:57:52.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:57:52.917 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 msgr2=0x7f85c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 0x7f85c8068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85e41541a0 tx=0x7f85d0008040 comp rx=0 tx=0).stop 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 msgr2=0x7f85e4157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ae040 tx=0x7f85d801aa80 comp rx=0 tx=0).stop 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 shutdown_connections 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85c8066470 0x7f85c8068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f85e40b5830 0x7f85e415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85e40ad710 0x7f85e414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 --2- 172.21.15.5:0/743252121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e40acd70 0x7f85e4157130 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:52.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 >> 172.21.15.5:0/743252121 conn(0x7f85e4071d80 msgr2=0x7f85e4151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:52.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 shutdown_connections 2023-11-24T07:57:52.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:52.917+0000 7f85eb172640 1 -- 172.21.15.5:0/743252121 wait complete. 2023-11-24T07:57:52.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T07:57:53.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 Processor -- start 2023-11-24T07:57:53.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 -- start start 2023-11-24T07:57:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861c0cdfb0 0x7f861c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f861c0cbd50 0x7f861c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c0cca80 con 0x7f861c0cdfb0 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c0ce8d0 con 0x7f861c0cbd50 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8620c32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0b2710 con 0x7f861c15a710 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861c0cdfb0 0x7f861c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861c0cdfb0 0x7f861c0abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53052/0 (socket says 172.21.15.5:53052) 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 -- 172.21.15.5:0/1815784859 learned_addr learned my addr 172.21.15.5:0/1815784859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861ad9d640 1 --2- 172.21.15.5:0/1815784859 >> v2:172.21.15.102:3300/0 conn(0x7f861c0cbd50 0x7f861c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f8613fff640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 -- 172.21.15.5:0/1815784859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 msgr2=0x7f861c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 -- 172.21.15.5:0/1815784859 >> v2:172.21.15.102:3300/0 conn(0x7f861c0cbd50 msgr2=0x7f861c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 --2- 172.21.15.5:0/1815784859 >> v2:172.21.15.102:3300/0 conn(0x7f861c0cbd50 0x7f861c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.085+0000 7f861a59c640 1 -- 172.21.15.5:0/1815784859 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c0b29f0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f861a59c640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c0abf90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f861c09d1d0 tx=0x7f860c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e880786bf2c5d3d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8619d9b640 1 -- 172.21.15.5:0/1815784859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c0aa5f0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8619d9b640 1 -- 172.21.15.5:0/1815784859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c0aa750 con 0x7f861c0cdfb0 2023-11-24T07:57:53.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8619d9b640 1 -- 172.21.15.5:0/1815784859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c0aaae0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 -- 172.21.15.5:0/1815784859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 msgr2=0x7f861c0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c0abf90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f861c09d1d0 tx=0x7f860c01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 -- 172.21.15.5:0/1815784859 shutdown_connections 2023-11-24T07:57:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 --2- 172.21.15.5:0/1815784859 >> v2:172.21.15.102:3300/0 conn(0x7f861c0cbd50 0x7f861c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 --2- 172.21.15.5:0/1815784859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c0abf90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 -- 172.21.15.5:0/1815784859 >> 172.21.15.5:0/1815784859 conn(0x7f861c0b0cb0 msgr2=0x7f861c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 -- 172.21.15.5:0/1815784859 shutdown_connections 2023-11-24T07:57:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.089+0000 7f8620c32640 1 -- 172.21.15.5:0/1815784859 wait complete. 2023-11-24T07:57:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 Processor -- start 2023-11-24T07:57:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- start start 2023-11-24T07:57:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f861c0cbd50 0x7f861c09c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c163500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c09c1a0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c163d30 con 0x7f861c0cbd50 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c09bae0 con 0x7f861c15a710 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53066/0 (socket says 172.21.15.5:53066) 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 -- 172.21.15.5:0/3148154122 learned_addr learned my addr 172.21.15.5:0/3148154122 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f861a59c640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f861c0cbd50 0x7f861c09c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f861ad9d640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 -- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 msgr2=0x7f861c163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 -- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f861c0cbd50 msgr2=0x7f861c09c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f861c0cbd50 0x7f861c09c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 -- 172.21.15.5:0/3148154122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0094d0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8613fff640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f860400e840 tx=0x7f860400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604009510 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400ee90 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400cb80 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c09bdc0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c164010 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.093+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c0671f0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.097+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f860400cce0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.097+0000 7f8612ffd640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 0x7f85fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.097+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8604083d90 con 0x7f861c0cdfb0 2023-11-24T07:57:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.097+0000 7f861a59c640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 0x7f85fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.097+0000 7f861a59c640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 0x7f85fc068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f860c0ae000 tx=0x7f860c0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.101+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86040512b0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.257+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f861c15ebe0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8612ffd640 1 -- 172.21.15.5:0/3148154122 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86040548d0 con 0x7f861c0cdfb0 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 msgr2=0x7f85fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 0x7f85fc068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f860c0ae000 tx=0x7f860c0b5040 comp rx=0 tx=0).stop 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 msgr2=0x7f861c159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f860400e840 tx=0x7f860400ec40 comp rx=0 tx=0).stop 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 shutdown_connections 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f85fc0664a0 0x7f85fc068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f861c15a710 0x7f861c163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861c0cdfb0 0x7f861c159b30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 --2- 172.21.15.5:0/3148154122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f861c0cbd50 0x7f861c09c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 >> 172.21.15.5:0/3148154122 conn(0x7f861c0b0cb0 msgr2=0x7f861c0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 shutdown_connections 2023-11-24T07:57:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.261+0000 7f8620c32640 1 -- 172.21.15.5:0/3148154122 wait complete. 2023-11-24T07:57:53.283 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T07:57:53.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T07:57:53.376 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T07:57:53.422 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T07:57:53.423 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:53.423 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:53.432 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:53.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:53.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 Processor -- start 2023-11-24T07:57:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 -- start start 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e800cead0 0x7f0e800d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e800d1eb0 0x7f0e8006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800cefd0 con 0x7f0e8015d7b0 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e800d17e0 con 0x7f0e800d1eb0 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e87bd1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800d2340 con 0x7f0e800cead0 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e8596d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e8015d7b0 0x7f0e800d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42348/0 (socket says 172.21.15.5:42348) 2023-11-24T07:57:53.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e8596d640 1 -- 172.21.15.5:0/1305972909 learned_addr learned my addr 172.21.15.5:0/1305972909 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e8616e640 1 --2- 172.21.15.5:0/1305972909 >> v2:172.21.15.102:3300/0 conn(0x7f0e800d1eb0 0x7f0e8006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.669+0000 7f0e8516c640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e800cead0 0x7f0e800d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526039888 0 0) 0x7f0e800cefd0 con 0x7f0e8015d7b0 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c003530 con 0x7f0e8015d7b0 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246230475 0 0) 0x7f0e6c003530 con 0x7f0e8015d7b0 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8616e640 1 -- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e800cead0 msgr2=0x7f0e800d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8616e640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e800cead0 0x7f0e800d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8616e640 1 -- 172.21.15.5:0/1305972909 >> v1:172.21.15.5:6789/0 conn(0x7f0e8015d7b0 legacy=0x7f0e800d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8616e640 1 -- 172.21.15.5:0/1305972909 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800cf2b0 con 0x7f0e800d1eb0 2023-11-24T07:57:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8616e640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e8006bed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009d90 tx=0x7f0e7801c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6840bc2d433fe5e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c001680 con 0x7f0e800d1eb0 2023-11-24T07:57:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e780a5520 con 0x7f0e800d1eb0 2023-11-24T07:57:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.673+0000 7f0e8496b640 1 -- 172.21.15.5:0/1305972909 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780a58b0 con 0x7f0e800d1eb0 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 msgr2=0x7f0e8006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e8006bed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009d90 tx=0x7f0e7801c720 comp rx=0 tx=0).stop 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- 172.21.15.5:0/1305972909 shutdown_connections 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e8006bed0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/1305972909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e800cead0 0x7f0e800d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- 172.21.15.5:0/1305972909 >> 172.21.15.5:0/1305972909 conn(0x7f0e800d33b0 msgr2=0x7f0e800d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:53.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- 172.21.15.5:0/1305972909 shutdown_connections 2023-11-24T07:57:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- 172.21.15.5:0/1305972909 wait complete. 2023-11-24T07:57:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 Processor -- start 2023-11-24T07:57:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- start start 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e800cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8015d7b0 0x7f0e800b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c9d90 con 0x7f0e800cead0 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cc6d0 con 0x7f0e800d1eb0 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e87bd1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cc9b0 con 0x7f0e8015d7b0 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53072/0 (socket says 172.21.15.5:53072) 2023-11-24T07:57:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 -- 172.21.15.5:0/368764103 learned_addr learned my addr 172.21.15.5:0/368764103 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8516c640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e800cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8616e640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8015d7b0 0x7f0e800b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 -- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8015d7b0 msgr2=0x7f0e800b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8015d7b0 0x7f0e800b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 -- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 msgr2=0x7f0e800cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e800cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.677+0000 7f0e8596d640 1 -- 172.21.15.5:0/368764103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009a70 con 0x7f0e800cead0 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e8596d640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00c750 tx=0x7f0e7c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c005ae0 con 0x7f0e800cead0 2023-11-24T07:57:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c005c40 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e800ccc90 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c007070 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800b1c70 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e800cc4c0 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e7c0071f0 con 0x7f0e800cead0 2023-11-24T07:57:53.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 0x7f0e64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e7c083bd0 con 0x7f0e800cead0 2023-11-24T07:57:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.681+0000 7f0e8516c640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 0x7f0e64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.685+0000 7f0e8516c640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 0x7f0e64068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e800c6dc0 tx=0x7f0e70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:53.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.685+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e7c0510f0 con 0x7f0e800cead0 2023-11-24T07:57:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.845+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e800c9ed0 con 0x7f0e800cead0 2023-11-24T07:57:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.845+0000 7f0e767fc640 1 -- 172.21.15.5:0/368764103 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f0e7c054710 con 0x7f0e800cead0 2023-11-24T07:57:53.849 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:53.849 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 msgr2=0x7f0e64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 0x7f0e64068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e800c6dc0 tx=0x7f0e70009190 comp rx=0 tx=0).stop 2023-11-24T07:57:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 msgr2=0x7f0e800b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00c750 tx=0x7f0e7c00cc10 comp rx=0 tx=0).stop 2023-11-24T07:57:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 shutdown_connections 2023-11-24T07:57:53.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0e64066470 0x7f0e64068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8015d7b0 0x7f0e800b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e800d1eb0 0x7f0e800cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 --2- 172.21.15.5:0/368764103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e800cead0 0x7f0e800b1730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 >> 172.21.15.5:0/368764103 conn(0x7f0e800d33b0 msgr2=0x7f0e800d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 shutdown_connections 2023-11-24T07:57:53.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:53.849+0000 7f0e87bd1640 1 -- 172.21.15.5:0/368764103 wait complete. 2023-11-24T07:57:53.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:57:41.453701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:57:41.884898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:53.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.013+0000 7fd905af5640 1 Processor -- start 2023-11-24T07:57:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.013+0000 7fd905af5640 1 -- start start 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd905af5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd9000b5090 0x7fd9000d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd905af5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000b6250 con 0x7fd9000b4c40 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd905af5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd900161cf0 con 0x7fd90015d2a0 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd905af5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000ce8c0 con 0x7fd9000b5090 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8fffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9000b4c40 0x7fd9000d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42358/0 (socket says 172.21.15.5:42358) 2023-11-24T07:57:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8fffff640 1 -- 172.21.15.5:0/4249683649 learned_addr learned my addr 172.21.15.5:0/4249683649 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd9052f4640 1 --2- 172.21.15.5:0/4249683649 >> v2:172.21.15.102:3300/0 conn(0x7fd9000b5090 0x7fd9000d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254253207 0 0) 0x7fd9000b6250 con 0x7fd9000b4c40 2023-11-24T07:57:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f0003530 con 0x7fd9000b4c40 2023-11-24T07:57:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204132349 0 0) 0x7fd900161cf0 con 0x7fd90015d2a0 2023-11-24T07:57:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9000b6250 con 0x7fd90015d2a0 2023-11-24T07:57:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd9052f4640 1 -- 172.21.15.5:0/4249683649 >> v1:172.21.15.102:6789/0 conn(0x7fd90015d2a0 legacy=0x7fd9000d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd9052f4640 1 -- 172.21.15.5:0/4249683649 >> v1:172.21.15.5:6789/0 conn(0x7fd9000b4c40 legacy=0x7fd9000d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.017+0000 7fd9052f4640 1 -- 172.21.15.5:0/4249683649 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900161170 con 0x7fd9000b5090 2023-11-24T07:57:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd9052f4640 1 --2- 172.21.15.5:0/4249683649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9000b5090 0x7fd9000d17f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009d90 tx=0x7fd8f801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795be15098dd177f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80a59e0 con 0x7fd9000b5090 2023-11-24T07:57:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f80a5b40 con 0x7fd9000b5090 2023-11-24T07:57:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd8ff7fe640 1 -- 172.21.15.5:0/4249683649 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80ad440 con 0x7fd9000b5090 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- 172.21.15.5:0/4249683649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9000b5090 msgr2=0x7fd9000d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 --2- 172.21.15.5:0/4249683649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9000b5090 0x7fd9000d17f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009d90 tx=0x7fd8f801c920 comp rx=0 tx=0).stop 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- 172.21.15.5:0/4249683649 shutdown_connections 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 --2- 172.21.15.5:0/4249683649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9000b5090 0x7fd9000d17f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- 172.21.15.5:0/4249683649 >> 172.21.15.5:0/4249683649 conn(0x7fd9000668a0 msgr2=0x7fd9000cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- 172.21.15.5:0/4249683649 shutdown_connections 2023-11-24T07:57:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- 172.21.15.5:0/4249683649 wait complete. 2023-11-24T07:57:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 Processor -- start 2023-11-24T07:57:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.021+0000 7fd905af5640 1 -- start start 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 0x7fd9000cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd90015d2a0 0x7fd9000b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90015a7a0 con 0x7fd9000b5090 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000ccbb0 con 0x7fd90015d2a0 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90015a3c0 con 0x7fd9000b4c40 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53084/0 (socket says 172.21.15.5:53084) 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 -- 172.21.15.5:0/3832757774 learned_addr learned my addr 172.21.15.5:0/3832757774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd9052f4640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd90015d2a0 0x7fd9000b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd904af3640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 0x7fd9000cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 -- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 msgr2=0x7fd9000cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 0x7fd9000cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 -- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd90015d2a0 msgr2=0x7fd9000b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd90015d2a0 0x7fd9000b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 -- 172.21.15.5:0/3832757774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009a70 con 0x7fd9000b5090 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd904af3640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 0x7fd9000cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fffff640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c410 tx=0x7fd8ec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec005cf0 con 0x7fd9000b5090 2023-11-24T07:57:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec005e50 con 0x7fd9000b5090 2023-11-24T07:57:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000cd630 con 0x7fd9000b5090 2023-11-24T07:57:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0072d0 con 0x7fd9000b5090 2023-11-24T07:57:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9000cd070 con 0x7fd9000b5090 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90015a8e0 con 0x7fd9000b5090 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.025+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8ec007430 con 0x7fd9000b5090 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.029+0000 7fd8fd7fa640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.029+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec083370 con 0x7fd9000b5090 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.029+0000 7fd904af3640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.029+0000 7fd904af3640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 0x7fd8e4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40011f0 tx=0x7fd8f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.033+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd90015a8e0 con 0x7fd9000b5090 2023-11-24T07:57:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.189+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd90015a8e0 con 0x7fd9000b5090 2023-11-24T07:57:54.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd8fd7fa640 1 -- 172.21.15.5:0/3832757774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd90015a8e0 con 0x7fd9000b5090 2023-11-24T07:57:54.194 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 msgr2=0x7fd8e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 0x7fd8e4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40011f0 tx=0x7fd8f4009040 comp rx=0 tx=0).stop 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 msgr2=0x7fd900157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c410 tx=0x7fd8ec00c8d0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 shutdown_connections 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd90015d2a0 0x7fd9000b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b5090 0x7fd900157800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 --2- 172.21.15.5:0/3832757774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9000b4c40 0x7fd9000cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 >> 172.21.15.5:0/3832757774 conn(0x7fd9000668a0 msgr2=0x7fd9001588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 shutdown_connections 2023-11-24T07:57:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.193+0000 7fd905af5640 1 -- 172.21.15.5:0/3832757774 wait complete. 2023-11-24T07:57:54.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:54.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.357+0000 7f473e2aa640 1 Processor -- start 2023-11-24T07:57:54.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.357+0000 7f473e2aa640 1 -- start start 2023-11-24T07:57:54.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473e2aa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f47380ae680 0x7f473815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473e2aa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f473815e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473e2aa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4738072950 con 0x7f4738159f00 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473e2aa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47380cc130 con 0x7f47380ae680 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473e2aa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473815e770 con 0x7f473815dda0 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4737fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4738159f00 0x7f47380cba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42372/0 (socket says 172.21.15.5:42372) 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4737fff640 1 -- 172.21.15.5:0/2969173214 learned_addr learned my addr 172.21.15.5:0/2969173214 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473c847640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f473815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 --2- 172.21.15.5:0/2969173214 >> v2:172.21.15.102:3300/0 conn(0x7f47380ae680 0x7f473815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21429227 0 0) 0x7f4738072950 con 0x7f4738159f00 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4720005740 con 0x7f4738159f00 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1132227926 0 0) 0x7f4720005740 con 0x7f4738159f00 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 msgr2=0x7f473815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f473815e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 >> v2:172.21.15.102:3300/0 conn(0x7f47380ae680 msgr2=0x7f473815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 --2- 172.21.15.5:0/2969173214 >> v2:172.21.15.102:3300/0 conn(0x7f47380ae680 0x7f473815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473806e2b0 con 0x7f4738159f00 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f4728001680 con 0x7f4738159f00 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 >> v1:172.21.15.5:6789/0 conn(0x7f4738159f00 legacy=0x7f47380cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4720005b90 0x7f4720005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47200069e0 0x7f4720006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f47200073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47380cc130 con 0x7f47200069e0 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473815e770 con 0x7f4720005b90 2023-11-24T07:57:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472000dba0 con 0x7f473815dda0 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47200069e0 0x7f4720006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f4737fff640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4720005b90 0x7f4720005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473c847640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f47200073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 -- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 msgr2=0x7f47200073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f47200073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 -- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4720005b90 msgr2=0x7f4720005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4720005b90 0x7f4720005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f47377fe640 1 -- 172.21.15.5:0/2969173214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720005740 con 0x7f47200069e0 2023-11-24T07:57:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.361+0000 7f473c847640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f473815dda0 0x7f47200073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:54.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f47377fe640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47200069e0 0x7f4720006e60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f472c009ae0 tx=0x7f472c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aac5cefa9637374 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0a55a0 con 0x7f47200069e0 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c0a5700 con 0x7f47200069e0 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f4736ffd640 1 -- 172.21.15.5:0/2969173214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0a5ab0 con 0x7f47200069e0 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 -- 172.21.15.5:0/2969173214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47200069e0 msgr2=0x7f4720006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 --2- 172.21.15.5:0/2969173214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47200069e0 0x7f4720006e60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f472c009ae0 tx=0x7f472c01ca90 comp rx=0 tx=0).stop 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473c847640 1 -- 172.21.15.5:0/2969173214 reap_dead start 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 -- 172.21.15.5:0/2969173214 shutdown_connections 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 -- 172.21.15.5:0/2969173214 >> 172.21.15.5:0/2969173214 conn(0x7f47380b0cb0 msgr2=0x7f47380b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 -- 172.21.15.5:0/2969173214 shutdown_connections 2023-11-24T07:57:54.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.365+0000 7f473e2aa640 1 -- 172.21.15.5:0/2969173214 wait complete. 2023-11-24T07:57:54.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 Processor -- start 2023-11-24T07:57:54.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- start start 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47200069e0 0x7f4738099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4738149c70 0x7f47380b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473814a0f0 con 0x7f47380b2120 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47380b28b0 con 0x7f4738149c70 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47380b2b90 con 0x7f47200069e0 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f4737fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47200069e0 0x7f4738099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53096/0 (socket says 172.21.15.5:53096) 2023-11-24T07:57:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 -- 172.21.15.5:0/3234371723 learned_addr learned my addr 172.21.15.5:0/3234371723 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f47377fe640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4738149c70 0x7f47380b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 -- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47200069e0 msgr2=0x7f4738099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47200069e0 0x7f4738099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 -- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4738149c70 msgr2=0x7f47380b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4738149c70 0x7f47380b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 -- 172.21.15.5:0/3234371723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380b2e70 con 0x7f47380b2120 2023-11-24T07:57:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473c847640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f473809d2e0 tx=0x7f4730010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000e050 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473000f040 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300039a0 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47380b3150 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47380b25a0 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.369+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47380671f0 con 0x7f47380b2120 2023-11-24T07:57:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.373+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4730003b00 con 0x7f47380b2120 2023-11-24T07:57:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.373+0000 7f4734ff9640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.373+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4730084270 con 0x7f47380b2120 2023-11-24T07:57:54.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.373+0000 7f4737fff640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.373+0000 7f4737fff640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4728005180 tx=0x7f4728007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.377+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47300516e0 con 0x7f47380b2120 2023-11-24T07:57:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.533+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f473806b460 con 0x7f47380b2120 2023-11-24T07:57:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.533+0000 7f4734ff9640 1 -- 172.21.15.5:0/3234371723 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4730054d00 con 0x7f47380b2120 2023-11-24T07:57:54.538 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 msgr2=0x7f4724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4728005180 tx=0x7f4728007900 comp rx=0 tx=0).stop 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 msgr2=0x7f473809a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f473809d2e0 tx=0x7f4730010590 comp rx=0 tx=0).stop 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 shutdown_connections 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47380b2120 0x7f473809a440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4738149c70 0x7f47380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 --2- 172.21.15.5:0/3234371723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47200069e0 0x7f4738099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 >> 172.21.15.5:0/3234371723 conn(0x7f47380b0cb0 msgr2=0x7f47380cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 shutdown_connections 2023-11-24T07:57:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.537+0000 7f473e2aa640 1 -- 172.21.15.5:0/3234371723 wait complete. 2023-11-24T07:57:54.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:54.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.701+0000 7f13d8c9c640 1 Processor -- start 2023-11-24T07:57:54.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.701+0000 7f13d8c9c640 1 -- start start 2023-11-24T07:57:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d8c9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d8c9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40d1de0 con 0x7f13d40b4c20 2023-11-24T07:57:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d8c9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40d14f0 con 0x7f13d40b2580 2023-11-24T07:57:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d8c9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d415d7f0 con 0x7f13d415d410 2023-11-24T07:57:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f13d40b4c20 0x7f13d40d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42376/0 (socket says 172.21.15.5:42376) 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d3fff640 1 -- 172.21.15.5:0/1998529029 learned_addr learned my addr 172.21.15.5:0/1998529029 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d37fe640 1 --2- 172.21.15.5:0/1998529029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313522883 0 0) 0x7f13d40d1de0 con 0x7f13d40b4c20 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13bc003530 con 0x7f13d40b4c20 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754675922 0 0) 0x7f13d40d14f0 con 0x7f13d40b2580 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13d40d1de0 con 0x7f13d40b2580 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d37fe640 1 -- 172.21.15.5:0/1998529029 >> v1:172.21.15.102:6789/0 conn(0x7f13d40b2580 legacy=0x7f13d40b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d37fe640 1 -- 172.21.15.5:0/1998529029 >> v1:172.21.15.5:6789/0 conn(0x7f13d40b4c20 legacy=0x7f13d40d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.705+0000 7f13d37fe640 1 -- 172.21.15.5:0/1998529029 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40d1790 con 0x7f13d415d410 2023-11-24T07:57:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d37fe640 1 --2- 172.21.15.5:0/1998529029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40b89e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13c40097f0 tx=0x7f13c401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2692640c103bda server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c40a89b0 con 0x7f13d415d410 2023-11-24T07:57:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c40a8b10 con 0x7f13d415d410 2023-11-24T07:57:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d27fc640 1 -- 172.21.15.5:0/1998529029 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c40a8ea0 con 0x7f13d415d410 2023-11-24T07:57:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1998529029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 msgr2=0x7f13d40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1998529029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40b89e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13c40097f0 tx=0x7f13c401ecb0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1998529029 shutdown_connections 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1998529029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40b89e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1998529029 >> 172.21.15.5:0/1998529029 conn(0x7f13d40668a0 msgr2=0x7f13d40cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1998529029 shutdown_connections 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1998529029 wait complete. 2023-11-24T07:57:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 Processor -- start 2023-11-24T07:57:54.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.709+0000 7f13d8c9c640 1 -- start start 2023-11-24T07:57:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d40b2580 0x7f13d40c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4155f30 con 0x7f13d40b4c20 2023-11-24T07:57:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40ae6c0 con 0x7f13d40b2580 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40ca040 con 0x7f13d415d410 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53102/0 (socket says 172.21.15.5:53102) 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 -- 172.21.15.5:0/1255063865 learned_addr learned my addr 172.21.15.5:0/1255063865 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d37fe640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d40b2580 0x7f13d40c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d3fff640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 -- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 msgr2=0x7f13d40acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 -- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d40b2580 msgr2=0x7f13d40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d40b2580 0x7f13d40c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 -- 172.21.15.5:0/1255063865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4009420 con 0x7f13d40b4c20 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d2ffd640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c490 tx=0x7f13c800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80052d0 con 0x7f13d40b4c20 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8005430 con 0x7f13d40b4c20 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8012870 con 0x7f13d40b4c20 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d41596c0 con 0x7f13d40b4c20 2023-11-24T07:57:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d4159c80 con 0x7f13d40b4c20 2023-11-24T07:57:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d4074990 con 0x7f13d40b4c20 2023-11-24T07:57:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.713+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13c80129d0 con 0x7f13d40b4c20 2023-11-24T07:57:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.717+0000 7f13bbfff640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 0x7f13c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.717+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13c8083aa0 con 0x7f13d40b4c20 2023-11-24T07:57:54.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.717+0000 7f13d37fe640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 0x7f13c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:54.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.717+0000 7f13d37fe640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 0x7f13c0068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13c40b2000 tx=0x7f13c40aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.721+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13c8050e80 con 0x7f13d40b4c20 2023-11-24T07:57:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13d40d37d0 con 0x7f13d40b4c20 2023-11-24T07:57:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13bbfff640 1 -- 172.21.15.5:0/1255063865 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13c80544a0 con 0x7f13d40b4c20 2023-11-24T07:57:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:54.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 msgr2=0x7f13c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 0x7f13c0068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13c40b2000 tx=0x7f13c40aa070 comp rx=0 tx=0).stop 2023-11-24T07:57:54.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 msgr2=0x7f13d40ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f13c800c490 tx=0x7f13c800c950 comp rx=0 tx=0).stop 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 shutdown_connections 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13c0066470 0x7f13c0068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13d415d410 0x7f13d40acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13d40b4c20 0x7f13d40ac670 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 --2- 172.21.15.5:0/1255063865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d40b2580 0x7f13d40c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 >> 172.21.15.5:0/1255063865 conn(0x7f13d40668a0 msgr2=0x7f13d40d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 shutdown_connections 2023-11-24T07:57:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:54.877+0000 7f13d8c9c640 1 -- 172.21.15.5:0/1255063865 wait complete. 2023-11-24T07:57:54.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 Processor -- start 2023-11-24T07:57:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 -- start start 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f083c0b3c60 0x7f083c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c0b2590 con 0x7f083c0b4040 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0b2870 con 0x7f083c0b3c60 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0843a9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0b2b50 con 0x7f083c162190 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841838640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f083c0b3c60 0x7f083c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841037640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f083c0b4040 0x7f083c0ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42392/0 (socket says 172.21.15.5:42392) 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841037640 1 -- 172.21.15.5:0/1388238835 learned_addr learned my addr 172.21.15.5:0/1388238835 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0842039640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841838640 1 -- 172.21.15.5:0/1388238835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 msgr2=0x7f083c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841838640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841838640 1 -- 172.21.15.5:0/1388238835 >> v1:172.21.15.5:6789/0 conn(0x7f083c0b4040 legacy=0x7f083c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0841838640 1 -- 172.21.15.5:0/1388238835 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c0b2e30 con 0x7f083c0b3c60 2023-11-24T07:57:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.045+0000 7f0840836640 1 -- 172.21.15.5:0/1388238835 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938403295 0 0) 0x7f083c0b2590 con 0x7f083c0b4040 2023-11-24T07:57:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0841838640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c0b1fb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f08380097c0 tx=0x7f083801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d6a8a3b65bd077 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0840836640 1 -- 172.21.15.5:0/1388238835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380ab670 con 0x7f083c0b3c60 2023-11-24T07:57:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0840836640 1 -- 172.21.15.5:0/1388238835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08380ab7d0 con 0x7f083c0b3c60 2023-11-24T07:57:55.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0840836640 1 -- 172.21.15.5:0/1388238835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380abb60 con 0x7f083c0b3c60 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 -- 172.21.15.5:0/1388238835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 msgr2=0x7f083c0b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c0b1fb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f08380097c0 tx=0x7f083801c450 comp rx=0 tx=0).stop 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 -- 172.21.15.5:0/1388238835 shutdown_connections 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c1625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1388238835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c0b1fb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 -- 172.21.15.5:0/1388238835 >> 172.21.15.5:0/1388238835 conn(0x7f083c0b0cb0 msgr2=0x7f083c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:55.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 -- 172.21.15.5:0/1388238835 shutdown_connections 2023-11-24T07:57:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.049+0000 7f0843a9c640 1 -- 172.21.15.5:0/1388238835 wait complete. 2023-11-24T07:57:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 Processor -- start 2023-11-24T07:57:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- start start 2023-11-24T07:57:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 0x7f083c1481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c148700 con 0x7f083c0b3c60 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c1634a0 con 0x7f083c099a30 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c163780 con 0x7f083c162190 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53120/0 (socket says 172.21.15.5:53120) 2023-11-24T07:57:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 -- 172.21.15.5:0/1391095567 learned_addr learned my addr 172.21.15.5:0/1391095567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0842039640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 0x7f083c1481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 -- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 msgr2=0x7f083c164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841037640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c164540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 -- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 msgr2=0x7f083c1481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 0x7f083c1481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 -- 172.21.15.5:0/1391095567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009420 con 0x7f083c0b3c60 2023-11-24T07:57:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0842039640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 0x7f083c1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841037640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0841838640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08380ad040 tx=0x7f083801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380b58d0 con 0x7f083c0b3c60 2023-11-24T07:57:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08380b5a50 con 0x7f083c0b3c60 2023-11-24T07:57:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380b5e00 con 0x7f083c0b3c60 2023-11-24T07:57:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c163a60 con 0x7f083c0b3c60 2023-11-24T07:57:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c164020 con 0x7f083c0b3c60 2023-11-24T07:57:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.053+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c0671f0 con 0x7f083c0b3c60 2023-11-24T07:57:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.057+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08380bf410 con 0x7f083c0b3c60 2023-11-24T07:57:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.057+0000 7f08327fc640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 0x7f0820068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.057+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f083811eb40 con 0x7f083c0b3c60 2023-11-24T07:57:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.057+0000 7f0841037640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 0x7f0820068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.057+0000 7f0841037640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 0x7f0820068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f083c09d0f0 tx=0x7f082c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.061+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08380ebf20 con 0x7f083c0b3c60 2023-11-24T07:57:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f083c1638c0 con 0x7f083c0b3c60 2023-11-24T07:57:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f08327fc640 1 -- 172.21.15.5:0/1391095567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f083c1638c0 con 0x7f083c0b3c60 2023-11-24T07:57:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 msgr2=0x7f0820068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 0x7f0820068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f083c09d0f0 tx=0x7f082c009040 comp rx=0 tx=0).stop 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 msgr2=0x7f083c162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08380ad040 tx=0x7f083801ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 shutdown_connections 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f08200664a0 0x7f0820068960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f083c099a30 0x7f083c1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f083c162190 0x7f083c164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 --2- 172.21.15.5:0/1391095567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f083c0b3c60 0x7f083c162ec0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 >> 172.21.15.5:0/1391095567 conn(0x7f083c0b0cb0 msgr2=0x7f083c06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 shutdown_connections 2023-11-24T07:57:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.229+0000 7f0843a9c640 1 -- 172.21.15.5:0/1391095567 wait complete. 2023-11-24T07:57:55.253 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T07:57:55.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:55.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T07:57:55.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:57:55.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:55.281 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T07:57:55.331 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:55.331 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:55.341 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:55.341 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:55.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 Processor -- start 2023-11-24T07:57:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 -- start start 2023-11-24T07:57:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a41614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70a41620d0 0x7f70a4161a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a40ce6c0 con 0x7f70a40b2990 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40cddd0 con 0x7f70a41620d0 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a9e32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a406d210 con 0x7f70a40b25b0 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70a41620d0 0x7f70a4161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70a41620d0 0x7f70a4161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53122/0 (socket says 172.21.15.5:53122) 2023-11-24T07:57:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 -- 172.21.15.5:0/4063716474 learned_addr learned my addr 172.21.15.5:0/4063716474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a37fe640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a41614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 -- 172.21.15.5:0/4063716474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 msgr2=0x7f70a41614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a41614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 -- 172.21.15.5:0/4063716474 >> v1:172.21.15.102:6789/0 conn(0x7f70a40b2990 legacy=0x7f70a40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.533+0000 7f70a2ffd640 1 -- 172.21.15.5:0/4063716474 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a406cf30 con 0x7f70a41620d0 2023-11-24T07:57:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a2ffd640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a41620d0 0x7f70a4161a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7098006fd0 tx=0x7f709801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370d585e3e14a296 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a27fc640 1 -- 172.21.15.5:0/4063716474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980ab670 con 0x7f70a41620d0 2023-11-24T07:57:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a27fc640 1 -- 172.21.15.5:0/4063716474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980ab7d0 con 0x7f70a41620d0 2023-11-24T07:57:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a27fc640 1 -- 172.21.15.5:0/4063716474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980abb60 con 0x7f70a41620d0 2023-11-24T07:57:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 -- 172.21.15.5:0/4063716474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a41620d0 msgr2=0x7f70a4161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a41620d0 0x7f70a4161a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7098006fd0 tx=0x7f709801c4b0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 -- 172.21.15.5:0/4063716474 shutdown_connections 2023-11-24T07:57:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a41620d0 0x7f70a4161a00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 --2- 172.21.15.5:0/4063716474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a41614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 -- 172.21.15.5:0/4063716474 >> 172.21.15.5:0/4063716474 conn(0x7f70a409c710 msgr2=0x7f70a40d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 -- 172.21.15.5:0/4063716474 shutdown_connections 2023-11-24T07:57:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.537+0000 7f70a9e32640 1 -- 172.21.15.5:0/4063716474 wait complete. 2023-11-24T07:57:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 Processor -- start 2023-11-24T07:57:55.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- start start 2023-11-24T07:57:55.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a40b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 0x7f70a40d1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4152c30 con 0x7f70a40b2990 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4160af0 con 0x7f70a41620d0 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4153600 con 0x7f70a40b25b0 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53130/0 (socket says 172.21.15.5:53130) 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 -- 172.21.15.5:0/1291049538 learned_addr learned my addr 172.21.15.5:0/1291049538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a37fe640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a40b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a3fff640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 0x7f70a40d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 -- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 msgr2=0x7f70a40b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a40b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 -- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 msgr2=0x7f70a40d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 0x7f70a40d1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 -- 172.21.15.5:0/1291049538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009480 con 0x7f70a40b2990 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a3fff640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 0x7f70a40d1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a2ffd640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f709801cd50 tx=0x7f7098019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980abd50 con 0x7f70a40b2990 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980ab630 con 0x7f70a40b2990 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098003860 con 0x7f70a40b2990 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a40b65f0 con 0x7f70a40b2990 2023-11-24T07:57:55.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a41525e0 con 0x7f70a40b2990 2023-11-24T07:57:55.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.541+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a404e850 con 0x7f70a40b2990 2023-11-24T07:57:55.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.545+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70980039c0 con 0x7f70a40b2990 2023-11-24T07:57:55.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.545+0000 7f708bfff640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 0x7f7090068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.545+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f709811ece0 con 0x7f70a40b2990 2023-11-24T07:57:55.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.545+0000 7f70a37fe640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 0x7f7090068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.545+0000 7f70a37fe640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 0x7f7090068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7094007a60 tx=0x7f7094008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.549+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70980ec1f0 con 0x7f70a40b2990 2023-11-24T07:57:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a4152d70 con 0x7f70a40b2990 2023-11-24T07:57:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f708bfff640 1 -- 172.21.15.5:0/1291049538 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f70980c4020 con 0x7f70a40b2990 2023-11-24T07:57:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:55.712 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:55.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 msgr2=0x7f7090068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 0x7f7090068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7094007a60 tx=0x7f7094008040 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 msgr2=0x7f70a41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f709801cd50 tx=0x7f7098019250 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 shutdown_connections 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f7090066470 0x7f7090068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70a41620d0 0x7f70a40d1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70a40b2990 0x7f70a41530c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 --2- 172.21.15.5:0/1291049538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70a40b25b0 0x7f70a40b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.709+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 >> 172.21.15.5:0/1291049538 conn(0x7f70a409c710 msgr2=0x7f70a4161450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.713+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 shutdown_connections 2023-11-24T07:57:55.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.713+0000 7f70a9e32640 1 -- 172.21.15.5:0/1291049538 wait complete. 2023-11-24T07:57:55.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:57:41.453701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:57:41.884898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:55.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 Processor -- start 2023-11-24T07:57:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 -- start start 2023-11-24T07:57:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8078161f20 0x7f80780cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80780d0740 con 0x7f80780d02f0 2023-11-24T07:57:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80780d11a0 con 0x7f807815d7c0 2023-11-24T07:57:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807ee17640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80780d0f90 con 0x7f8078161f20 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807d3b4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80780d02f0 0x7f80780cdf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42396/0 (socket says 172.21.15.5:42396) 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f807d3b4640 1 -- 172.21.15.5:0/1843119113 learned_addr learned my addr 172.21.15.5:0/1843119113 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f8077fff640 1 --2- 172.21.15.5:0/1843119113 >> v2:172.21.15.5:3300/0 conn(0x7f8078161f20 0x7f80780cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f80777fe640 1 -- 172.21.15.5:0/1843119113 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241798067 0 0) 0x7f80700014a0 con 0x7f80780d02f0 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f8077fff640 1 -- 172.21.15.5:0/1843119113 >> v1:172.21.15.102:6789/0 conn(0x7f807815d7c0 legacy=0x7f80780d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f8077fff640 1 -- 172.21.15.5:0/1843119113 >> v1:172.21.15.5:6789/0 conn(0x7f80780d02f0 legacy=0x7f80780cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.877+0000 7f8077fff640 1 -- 172.21.15.5:0/1843119113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780d1480 con 0x7f8078161f20 2023-11-24T07:57:55.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f8077fff640 1 --2- 172.21.15.5:0/1843119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8078161f20 0x7f80780cfdb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f80640097a0 tx=0x7f806401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838d46fdd22c9042 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f80777fe640 1 -- 172.21.15.5:0/1843119113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640ac600 con 0x7f8078161f20 2023-11-24T07:57:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f80777fe640 1 -- 172.21.15.5:0/1843119113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80640a8050 con 0x7f8078161f20 2023-11-24T07:57:55.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f80777fe640 1 -- 172.21.15.5:0/1843119113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640ac980 con 0x7f8078161f20 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 -- 172.21.15.5:0/1843119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8078161f20 msgr2=0x7f80780cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 --2- 172.21.15.5:0/1843119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8078161f20 0x7f80780cfdb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f80640097a0 tx=0x7f806401c3a0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 -- 172.21.15.5:0/1843119113 shutdown_connections 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 --2- 172.21.15.5:0/1843119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8078161f20 0x7f80780cfdb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 -- 172.21.15.5:0/1843119113 >> 172.21.15.5:0/1843119113 conn(0x7f807808afc0 msgr2=0x7f80780d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 -- 172.21.15.5:0/1843119113 shutdown_connections 2023-11-24T07:57:55.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.881+0000 7f807ee17640 1 -- 172.21.15.5:0/1843119113 wait complete. 2023-11-24T07:57:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 Processor -- start 2023-11-24T07:57:55.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- start start 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80780d02f0 0x7f8078142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f807815a040 0x7f8078157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078150ed0 con 0x7f807815d7c0 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078142b50 con 0x7f80780d02f0 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807815a4e0 con 0x7f807815a040 2023-11-24T07:57:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53146/0 (socket says 172.21.15.5:53146) 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 -- 172.21.15.5:0/3989969485 learned_addr learned my addr 172.21.15.5:0/3989969485 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807cbb3640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80780d02f0 0x7f8078142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807d3b4640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f807815a040 0x7f8078157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 -- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f807815a040 msgr2=0x7f8078157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f807815a040 0x7f8078157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 -- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80780d02f0 msgr2=0x7f8078142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80780d02f0 0x7f8078142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 -- 172.21.15.5:0/3989969485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640093b0 con 0x7f807815d7c0 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f8077fff640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f80640097a0 tx=0x7f806401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640059a0 con 0x7f807815d7c0 2023-11-24T07:57:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8064005b00 con 0x7f807815d7c0 2023-11-24T07:57:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064005e70 con 0x7f807815d7c0 2023-11-24T07:57:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80781505a0 con 0x7f807815d7c0 2023-11-24T07:57:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.885+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078150b60 con 0x7f807815d7c0 2023-11-24T07:57:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078151080 con 0x7f807815d7c0 2023-11-24T07:57:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8064006030 con 0x7f807815d7c0 2023-11-24T07:57:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f80757fa640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 0x7f805c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f806411e6a0 con 0x7f807815d7c0 2023-11-24T07:57:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f807cbb3640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 0x7f805c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:55.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.889+0000 7f807cbb3640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 0x7f805c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f806c007fd0 tx=0x7f806c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:55.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:55.893+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8078151080 con 0x7f807815d7c0 2023-11-24T07:57:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8078151080 con 0x7f807815d7c0 2023-11-24T07:57:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f80757fa640 1 -- 172.21.15.5:0/3989969485 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8078151080 con 0x7f807815d7c0 2023-11-24T07:57:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 msgr2=0x7f805c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 0x7f805c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f806c007fd0 tx=0x7f806c009040 comp rx=0 tx=0).stop 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 msgr2=0x7f8078159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.053+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f80640097a0 tx=0x7f806401abe0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 shutdown_connections 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f805c0664a0 0x7f805c068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f807815a040 0x7f8078157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807815d7c0 0x7f8078159b00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 --2- 172.21.15.5:0/3989969485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80780d02f0 0x7f8078142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 >> 172.21.15.5:0/3989969485 conn(0x7f807808afc0 msgr2=0x7f807815ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 shutdown_connections 2023-11-24T07:57:56.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.057+0000 7f807ee17640 1 -- 172.21.15.5:0/3989969485 wait complete. 2023-11-24T07:57:56.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 Processor -- start 2023-11-24T07:57:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 -- start start 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 0x7f6acc0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc072950 con 0x7f6acc0ae680 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc06e2b0 con 0x7f6acc070890 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad3965640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc06c6f0 con 0x7f6acc159f00 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad0f00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6acc0ae680 0x7f6acc0cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42408/0 (socket says 172.21.15.5:42408) 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad0f00640 1 -- 172.21.15.5:0/4165922744 learned_addr learned my addr 172.21.15.5:0/4165922744 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ad1701640 1 --2- 172.21.15.5:0/4165922744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 0x7f6acc0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89640431 0 0) 0x7f6acc072950 con 0x7f6acc0ae680 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab8003530 con 0x7f6acc0ae680 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.221+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196580958 0 0) 0x7f6acc06e2b0 con 0x7f6acc070890 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad1701640 1 -- 172.21.15.5:0/4165922744 >> v1:172.21.15.102:6789/0 conn(0x7f6acc070890 legacy=0x7f6acc070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad1701640 1 -- 172.21.15.5:0/4165922744 >> v1:172.21.15.5:6789/0 conn(0x7f6acc0ae680 legacy=0x7f6acc0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad1701640 1 -- 172.21.15.5:0/4165922744 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc06e550 con 0x7f6acc159f00 2023-11-24T07:57:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad1701640 1 --2- 172.21.15.5:0/4165922744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 0x7f6acc0ccea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80097f0 tx=0x7f6ac801e6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83fc5bce49ef4679 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80aa650 con 0x7f6acc159f00 2023-11-24T07:57:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80aa7b0 con 0x7f6acc159f00 2023-11-24T07:57:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ac3fff640 1 -- 172.21.15.5:0/4165922744 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80aab20 con 0x7f6acc159f00 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad3965640 1 -- 172.21.15.5:0/4165922744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 msgr2=0x7f6acc0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.225+0000 7f6ad3965640 1 --2- 172.21.15.5:0/4165922744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 0x7f6acc0ccea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80097f0 tx=0x7f6ac801e6a0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- 172.21.15.5:0/4165922744 shutdown_connections 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 --2- 172.21.15.5:0/4165922744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc159f00 0x7f6acc0ccea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- 172.21.15.5:0/4165922744 >> 172.21.15.5:0/4165922744 conn(0x7f6acc0b0cb0 msgr2=0x7f6acc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- 172.21.15.5:0/4165922744 shutdown_connections 2023-11-24T07:57:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- 172.21.15.5:0/4165922744 wait complete. 2023-11-24T07:57:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 Processor -- start 2023-11-24T07:57:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- start start 2023-11-24T07:57:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc0ae680 0x7f6acc0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 0x7f6acc0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0ac4d0 con 0x7f6acc070890 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0ac6c0 con 0x7f6acc14bd90 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad3965640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0ac9a0 con 0x7f6acc0ae680 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53154/0 (socket says 172.21.15.5:53154) 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 -- 172.21.15.5:0/632051694 learned_addr learned my addr 172.21.15.5:0/632051694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad0f00640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc0ae680 0x7f6acc0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1f02640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 0x7f6acc0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 -- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc0ae680 msgr2=0x7f6acc0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc0ae680 0x7f6acc0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 -- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 msgr2=0x7f6acc0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 0x7f6acc0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 -- 172.21.15.5:0/632051694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8009420 con 0x7f6acc070890 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1f02640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 0x7f6acc0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.229+0000 7f6ad1701640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ac801c2d0 tx=0x7f6ac801b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80b6070 con 0x7f6acc070890 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80aa920 con 0x7f6acc070890 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80aac90 con 0x7f6acc070890 2023-11-24T07:57:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc0acc80 con 0x7f6acc070890 2023-11-24T07:57:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc0ad240 con 0x7f6acc070890 2023-11-24T07:57:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc0671f0 con 0x7f6acc070890 2023-11-24T07:57:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.233+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ac8003620 con 0x7f6acc070890 2023-11-24T07:57:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.237+0000 7f6ac1ffb640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 0x7f6ab0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.237+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ac811e4c0 con 0x7f6acc070890 2023-11-24T07:57:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.237+0000 7f6ad0f00640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 0x7f6ab0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.237+0000 7f6ad0f00640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 0x7f6ab0068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0caf60 tx=0x7f6abc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.237+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ac80eb8a0 con 0x7f6acc070890 2023-11-24T07:57:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.397+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6acc06b460 con 0x7f6acc070890 2023-11-24T07:57:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.397+0000 7f6ac1ffb640 1 -- 172.21.15.5:0/632051694 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ac80eeec0 con 0x7f6acc070890 2023-11-24T07:57:56.400 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 msgr2=0x7f6ab0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 0x7f6ab0068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0caf60 tx=0x7f6abc009040 comp rx=0 tx=0).stop 2023-11-24T07:57:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 msgr2=0x7f6acc1518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ac801c2d0 tx=0x7f6ac801b440 comp rx=0 tx=0).stop 2023-11-24T07:57:56.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 shutdown_connections 2023-11-24T07:57:56.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6ab00664a0 0x7f6ab0068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6acc14bd90 0x7f6acc0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6acc0ae680 0x7f6acc0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 --2- 172.21.15.5:0/632051694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6acc070890 0x7f6acc1518f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 >> 172.21.15.5:0/632051694 conn(0x7f6acc0b0cb0 msgr2=0x7f6acc0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 shutdown_connections 2023-11-24T07:57:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.401+0000 7f6ad3965640 1 -- 172.21.15.5:0/632051694 wait complete. 2023-11-24T07:57:56.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 Processor -- start 2023-11-24T07:57:56.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 -- start start 2023-11-24T07:57:56.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd68144d50 0x7fbd680b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd680b5160 0x7fbd6815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd6815f420 0x7fbd68070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815f8b0 con 0x7fbd680b5160 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815fcb0 con 0x7fbd68144d50 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6ff8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680b5790 con 0x7fbd6815f420 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6d528640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd680b5160 0x7fbd6815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6dd29640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd68144d50 0x7fbd680b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6d528640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd680b5160 0x7fbd6815eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53162/0 (socket says 172.21.15.5:53162) 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6d528640 1 -- 172.21.15.5:0/3985189774 learned_addr learned my addr 172.21.15.5:0/3985189774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.565+0000 7fbd6e52a640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd6815f420 0x7fbd68070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 -- 172.21.15.5:0/3985189774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd6815f420 msgr2=0x7fbd68070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd6815f420 0x7fbd68070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 -- 172.21.15.5:0/3985189774 >> v2:172.21.15.102:3300/0 conn(0x7fbd68144d50 msgr2=0x7fbd680b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 --2- 172.21.15.5:0/3985189774 >> v2:172.21.15.102:3300/0 conn(0x7fbd68144d50 0x7fbd680b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 -- 172.21.15.5:0/3985189774 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680b5a70 con 0x7fbd680b5160 2023-11-24T07:57:56.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6d528640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680b5160 0x7fbd6815eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd680d2320 tx=0x7fbd5801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5613ed729445997d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6cd27640 1 -- 172.21.15.5:0/3985189774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580ab600 con 0x7fbd680b5160 2023-11-24T07:57:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6cd27640 1 -- 172.21.15.5:0/3985189774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580a7050 con 0x7fbd680b5160 2023-11-24T07:57:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.569+0000 7fbd6cd27640 1 -- 172.21.15.5:0/3985189774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580ab980 con 0x7fbd680b5160 2023-11-24T07:57:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/3985189774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680b5160 msgr2=0x7fbd6815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680b5160 0x7fbd6815eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd680d2320 tx=0x7fbd5801c240 comp rx=0 tx=0).stop 2023-11-24T07:57:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/3985189774 shutdown_connections 2023-11-24T07:57:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd6815f420 0x7fbd68070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/3985189774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd680b5160 0x7fbd6815eee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/3985189774 >> v2:172.21.15.102:3300/0 conn(0x7fbd68144d50 0x7fbd680b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/3985189774 >> 172.21.15.5:0/3985189774 conn(0x7fbd680b2f10 msgr2=0x7fbd680b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/3985189774 shutdown_connections 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/3985189774 wait complete. 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 Processor -- start 2023-11-24T07:57:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- start start 2023-11-24T07:57:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd680b5160 0x7fbd681541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd68144d50 0x7fbd681403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd68139730 con 0x7fbd6815f420 2023-11-24T07:57:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd68139da0 con 0x7fbd68144d50 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6ff8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6813a080 con 0x7fbd680b5160 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53174/0 (socket says 172.21.15.5:53174) 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 -- 172.21.15.5:0/1841557033 learned_addr learned my addr 172.21.15.5:0/1841557033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6dd29640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd680b5160 0x7fbd681541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6d528640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd68144d50 0x7fbd681403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 -- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd680b5160 msgr2=0x7fbd681541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd680b5160 0x7fbd681541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 -- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd68144d50 msgr2=0x7fbd681403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd68144d50 0x7fbd681403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.573+0000 7fbd6e52a640 1 -- 172.21.15.5:0/1841557033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580094d0 con 0x7fbd6815f420 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd6e52a640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000efc0 tx=0x7fbd6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60009ba0 con 0x7fbd6815f420 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6000f040 con 0x7fbd6815f420 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd600146c0 con 0x7fbd6815f420 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6813a360 con 0x7fbd6815f420 2023-11-24T07:57:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6813a920 con 0x7fbd6815f420 2023-11-24T07:57:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6813ab10 con 0x7fbd6815f420 2023-11-24T07:57:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd60014820 con 0x7fbd6815f420 2023-11-24T07:57:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 0x7fbd4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd60084840 con 0x7fbd6815f420 2023-11-24T07:57:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.577+0000 7fbd6dd29640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 0x7fbd4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.581+0000 7fbd6dd29640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 0x7fbd4c068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009b60 tx=0x7fbd64009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.581+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd60051cd0 con 0x7fbd6815f420 2023-11-24T07:57:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.737+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd6804e850 con 0x7fbd6815f420 2023-11-24T07:57:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd5e7fc640 1 -- 172.21.15.5:0/1841557033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd60018020 con 0x7fbd6815f420 2023-11-24T07:57:56.742 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 msgr2=0x7fbd4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 0x7fbd4c068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009b60 tx=0x7fbd64009190 comp rx=0 tx=0).stop 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 msgr2=0x7fbd680b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000efc0 tx=0x7fbd6000c490 comp rx=0 tx=0).stop 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 shutdown_connections 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fbd4c066470 0x7fbd4c068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd6815f420 0x7fbd680b1770 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd68144d50 0x7fbd681403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 --2- 172.21.15.5:0/1841557033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd680b5160 0x7fbd681541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 >> 172.21.15.5:0/1841557033 conn(0x7fbd680b2f10 msgr2=0x7fbd6815b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 shutdown_connections 2023-11-24T07:57:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.741+0000 7fbd6ff8d640 1 -- 172.21.15.5:0/1841557033 wait complete. 2023-11-24T07:57:56.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T07:57:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 Processor -- start 2023-11-24T07:57:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 -- start start 2023-11-24T07:57:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff934159f00 0x7ff9340ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9340ae680 0x7ff9340cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934072950 con 0x7ff9340cd920 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406e2b0 con 0x7ff934159f00 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.905+0000 7ff939091640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406c6f0 con 0x7ff9340ae680 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff93359e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff9340cd920 0x7ff93415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42412/0 (socket says 172.21.15.5:42412) 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff934159f00 0x7ff9340ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff93359e640 1 -- 172.21.15.5:0/2325316517 learned_addr learned my addr 172.21.15.5:0/2325316517 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff93259c640 1 --2- 172.21.15.5:0/2325316517 >> v2:172.21.15.102:3300/0 conn(0x7ff9340ae680 0x7ff9340cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 -- 172.21.15.5:0/2325316517 >> v2:172.21.15.102:3300/0 conn(0x7ff9340ae680 msgr2=0x7ff9340cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 --2- 172.21.15.5:0/2325316517 >> v2:172.21.15.102:3300/0 conn(0x7ff9340ae680 0x7ff9340cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 -- 172.21.15.5:0/2325316517 >> v1:172.21.15.5:6789/0 conn(0x7ff9340cd920 legacy=0x7ff93415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 -- 172.21.15.5:0/2325316517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93406e550 con 0x7ff934159f00 2023-11-24T07:57:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff931d9b640 1 -- 172.21.15.5:0/2325316517 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860860682 0 0) 0x7ff934072950 con 0x7ff9340cd920 2023-11-24T07:57:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff932d9d640 1 --2- 172.21.15.5:0/2325316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff934159f00 0x7ff9340ccea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff9340d0040 tx=0x7ff92401d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59841c567aee1a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff931d9b640 1 -- 172.21.15.5:0/2325316517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240a6760 con 0x7ff934159f00 2023-11-24T07:57:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff931d9b640 1 -- 172.21.15.5:0/2325316517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240a68c0 con 0x7ff934159f00 2023-11-24T07:57:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.909+0000 7ff931d9b640 1 -- 172.21.15.5:0/2325316517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240a6c50 con 0x7ff934159f00 2023-11-24T07:57:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- 172.21.15.5:0/2325316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff934159f00 msgr2=0x7ff9340ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- 172.21.15.5:0/2325316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff934159f00 0x7ff9340ccea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff9340d0040 tx=0x7ff92401d800 comp rx=0 tx=0).stop 2023-11-24T07:57:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- 172.21.15.5:0/2325316517 shutdown_connections 2023-11-24T07:57:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- 172.21.15.5:0/2325316517 >> v2:172.21.15.102:3300/0 conn(0x7ff9340ae680 0x7ff9340cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- 172.21.15.5:0/2325316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff934159f00 0x7ff9340ccea0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- 172.21.15.5:0/2325316517 >> 172.21.15.5:0/2325316517 conn(0x7ff9340b0cb0 msgr2=0x7ff9340b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- 172.21.15.5:0/2325316517 shutdown_connections 2023-11-24T07:57:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- 172.21.15.5:0/2325316517 wait complete. 2023-11-24T07:57:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 Processor -- start 2023-11-24T07:57:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- start start 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 0x7ff9340ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 0x7ff934162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340ac370 con 0x7ff9340ae680 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340ac650 con 0x7ff9340adb70 2023-11-24T07:57:56.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff939091640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340ac930 con 0x7ff9340cd920 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff932d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff932d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53198/0 (socket says 172.21.15.5:53198) 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff932d9d640 1 -- 172.21.15.5:0/3648870281 learned_addr learned my addr 172.21.15.5:0/3648870281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff93259c640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 0x7ff9340ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.913+0000 7ff93359e640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 0x7ff934162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 -- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 msgr2=0x7ff9340ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 0x7ff9340ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 -- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 msgr2=0x7ff934162ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 0x7ff934162ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 -- 172.21.15.5:0/3648870281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92400a5c0 con 0x7ff9340ae680 2023-11-24T07:57:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff93259c640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 0x7ff9340ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff93359e640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 0x7ff934162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:56.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff932d9d640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff924000c10 tx=0x7ff92401a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004230 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924004390 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924003820 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9340acc10 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93415a2f0 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9340671f0 con 0x7ff9340ae680 2023-11-24T07:57:56.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.917+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9240b5050 con 0x7ff9340ae680 2023-11-24T07:57:56.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.921+0000 7ff91b7fe640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 0x7ff920068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:56.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.921+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff92411e750 con 0x7ff9340ae680 2023-11-24T07:57:56.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.921+0000 7ff93259c640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 0x7ff920068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:56.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.921+0000 7ff93259c640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 0x7ff920068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9340b17a0 tx=0x7ff928008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:56.925+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9240ebc50 con 0x7ff9340ae680 2023-11-24T07:57:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.092+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff93406b460 con 0x7ff9340ae680 2023-11-24T07:57:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.092+0000 7ff91b7fe640 1 -- 172.21.15.5:0/3648870281 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff9240ef270 con 0x7ff9340ae680 2023-11-24T07:57:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-11-24T07:57:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 msgr2=0x7ff920068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 0x7ff920068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9340b17a0 tx=0x7ff928008040 comp rx=0 tx=0).stop 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 msgr2=0x7ff9341f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff924000c10 tx=0x7ff92401a5a0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 shutdown_connections 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7ff920066470 0x7ff920068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9340adb70 0x7ff934162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9340cd920 0x7ff9340ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 --2- 172.21.15.5:0/3648870281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9340ae680 0x7ff9341f5f70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 >> 172.21.15.5:0/3648870281 conn(0x7ff9340b0cb0 msgr2=0x7ff9341538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 shutdown_connections 2023-11-24T07:57:57.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.096+0000 7ff939091640 1 -- 172.21.15.5:0/3648870281 wait complete. 2023-11-24T07:57:57.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T07:57:57.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:57.118 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T07:57:57.149 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:57:57.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:57:57.149 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T07:57:57.204 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:57:57.204 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:57.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T07:57:57.215 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:57:57.215 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:57:57.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T07:57:57.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:57.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.400+0000 7f362169c640 1 Processor -- start 2023-11-24T07:57:57.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.400+0000 7f362169c640 1 -- start start 2023-11-24T07:57:57.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f362169c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f361c0cfdb0 0x7f361c0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f362169c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0d12e0 con 0x7f361c1654c0 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f362169c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0d15c0 con 0x7f361c15d530 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f362169c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0d0760 con 0x7f361c0cfdb0 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f3613fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f361c0cfdb0 0x7f361c0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f361b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f361c1654c0 0x7f361c1678b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38416/0 (socket says 172.21.15.5:38416) 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f361b7fe640 1 -- 172.21.15.5:0/659879766 learned_addr learned my addr 172.21.15.5:0/659879766 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f3613fff640 1 -- 172.21.15.5:0/659879766 >> v1:172.21.15.102:6789/0 conn(0x7f361c15d530 legacy=0x7f361c0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f3613fff640 1 -- 172.21.15.5:0/659879766 >> v1:172.21.15.5:6789/0 conn(0x7f361c1654c0 legacy=0x7f361c1678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f3613fff640 1 -- 172.21.15.5:0/659879766 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0d18a0 con 0x7f361c0cfdb0 2023-11-24T07:57:57.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.404+0000 7f361a7fc640 1 -- 172.21.15.5:0/659879766 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185238960 0 0) 0x7f361c0d12e0 con 0x7f361c1654c0 2023-11-24T07:57:57.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f3613fff640 1 --2- 172.21.15.5:0/659879766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c0d0220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f36040097f0 tx=0x7f360401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23e6fd9794b6565 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f361a7fc640 1 -- 172.21.15.5:0/659879766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040a8970 con 0x7f361c0cfdb0 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f361a7fc640 1 -- 172.21.15.5:0/659879766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36040a8ad0 con 0x7f361c0cfdb0 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f361a7fc640 1 -- 172.21.15.5:0/659879766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040a8e60 con 0x7f361c0cfdb0 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- 172.21.15.5:0/659879766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 msgr2=0x7f361c0d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 --2- 172.21.15.5:0/659879766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c0d0220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f36040097f0 tx=0x7f360401ec70 comp rx=0 tx=0).stop 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- 172.21.15.5:0/659879766 shutdown_connections 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 --2- 172.21.15.5:0/659879766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c0d0220 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- 172.21.15.5:0/659879766 >> 172.21.15.5:0/659879766 conn(0x7f361c09c6d0 msgr2=0x7f361c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- 172.21.15.5:0/659879766 shutdown_connections 2023-11-24T07:57:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- 172.21.15.5:0/659879766 wait complete. 2023-11-24T07:57:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 Processor -- start 2023-11-24T07:57:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- start start 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f361c15d530 0x7f361c15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f361c1654c0 0x7f361c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c15ba50 con 0x7f361c0cfdb0 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c15bea0 con 0x7f361c1654c0 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.408+0000 7f362169c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0b5fe0 con 0x7f361c15d530 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58214/0 (socket says 172.21.15.5:58214) 2023-11-24T07:57:57.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 -- 172.21.15.5:0/1331308066 learned_addr learned my addr 172.21.15.5:0/1331308066 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f3613fff640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f361c15d530 0x7f361c15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361b7fe640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f361c1654c0 0x7f361c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 -- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f361c15d530 msgr2=0x7f361c15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f361c15d530 0x7f361c15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 -- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f361c1654c0 msgr2=0x7f361c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f361c1654c0 0x7f361c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 -- 172.21.15.5:0/1331308066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009420 con 0x7f361c0cfdb0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f361affd640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f360c00c530 tx=0x7f360c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c005220 con 0x7f361c0cfdb0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c005380 con 0x7f361c0cfdb0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c007270 con 0x7f361c0cfdb0 2023-11-24T07:57:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c1635b0 con 0x7f361c0cfdb0 2023-11-24T07:57:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c162f60 con 0x7f361c0cfdb0 2023-11-24T07:57:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c067a40 con 0x7f361c0cfdb0 2023-11-24T07:57:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f360c0073d0 con 0x7f361c0cfdb0 2023-11-24T07:57:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.412+0000 7f36137fe640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.416+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f360c083710 con 0x7f361c0cfdb0 2023-11-24T07:57:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.416+0000 7f3613fff640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.416+0000 7f3613fff640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 0x7f35fc068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f36040b2000 tx=0x7f3604008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.420+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f360c050b80 con 0x7f361c0cfdb0 2023-11-24T07:57:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f361c04e850 con 0x7f361c0cfdb0 2023-11-24T07:57:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f36137fe640 1 -- 172.21.15.5:0/1331308066 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f360c0541a0 con 0x7f361c0cfdb0 2023-11-24T07:57:57.611 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:57.611 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:57:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 msgr2=0x7f35fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 0x7f35fc068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f36040b2000 tx=0x7f3604008040 comp rx=0 tx=0).stop 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 msgr2=0x7f361c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f360c00c530 tx=0x7f360c00c9f0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 shutdown_connections 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f361c1654c0 0x7f361c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f361c15d530 0x7f361c15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 --2- 172.21.15.5:0/1331308066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f361c0cfdb0 0x7f361c15aa90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 >> 172.21.15.5:0/1331308066 conn(0x7f361c09c6d0 msgr2=0x7f361c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 shutdown_connections 2023-11-24T07:57:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.608+0000 7f362169c640 1 -- 172.21.15.5:0/1331308066 wait complete. 2023-11-24T07:57:57.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.772+0000 7fb4098c9640 1 Processor -- start 2023-11-24T07:57:57.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.772+0000 7fb4098c9640 1 -- start start 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4098c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb40406dfd0 0x7fb40406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4098c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb4040adcc0 0x7fb4040ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4098c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40406e980 con 0x7fb404143ae0 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4098c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb404070670 con 0x7fb40406dfd0 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4098c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb404070950 con 0x7fb4040adcc0 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb40406dfd0 0x7fb40406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb40406dfd0 0x7fb40406e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58222/0 (socket says 172.21.15.5:58222) 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 -- 172.21.15.5:0/3821823986 learned_addr learned my addr 172.21.15.5:0/3821823986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb4037fe640 1 --2- 172.21.15.5:0/3821823986 >> v2:172.21.15.102:3300/0 conn(0x7fb4040adcc0 0x7fb4040ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 -- 172.21.15.5:0/3821823986 >> v2:172.21.15.102:3300/0 conn(0x7fb4040adcc0 msgr2=0x7fb4040ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/3821823986 >> v2:172.21.15.102:3300/0 conn(0x7fb4040adcc0 0x7fb4040ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 -- 172.21.15.5:0/3821823986 >> v1:172.21.15.102:6789/0 conn(0x7fb404143ae0 legacy=0x7fb4040b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:57.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.776+0000 7fb3fbfff640 1 -- 172.21.15.5:0/3821823986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404070c30 con 0x7fb40406dfd0 2023-11-24T07:57:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/3821823986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb40406dfd0 0x7fb40406e440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb404072ad0 tx=0x7fb3ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84ee5834643bed2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4027fc640 1 -- 172.21.15.5:0/3821823986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0aa5f0 con 0x7fb40406dfd0 2023-11-24T07:57:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4027fc640 1 -- 172.21.15.5:0/3821823986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0aa750 con 0x7fb40406dfd0 2023-11-24T07:57:57.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4027fc640 1 -- 172.21.15.5:0/3821823986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0aaae0 con 0x7fb40406dfd0 2023-11-24T07:57:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- 172.21.15.5:0/3821823986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb40406dfd0 msgr2=0x7fb40406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- 172.21.15.5:0/3821823986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb40406dfd0 0x7fb40406e440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb404072ad0 tx=0x7fb3ec01c490 comp rx=0 tx=0).stop 2023-11-24T07:57:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- 172.21.15.5:0/3821823986 shutdown_connections 2023-11-24T07:57:57.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- 172.21.15.5:0/3821823986 >> v2:172.21.15.102:3300/0 conn(0x7fb4040adcc0 0x7fb4040ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- 172.21.15.5:0/3821823986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb40406dfd0 0x7fb40406e440 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- 172.21.15.5:0/3821823986 >> 172.21.15.5:0/3821823986 conn(0x7fb4040b0c40 msgr2=0x7fb4040b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- 172.21.15.5:0/3821823986 shutdown_connections 2023-11-24T07:57:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- 172.21.15.5:0/3821823986 wait complete. 2023-11-24T07:57:57.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 Processor -- start 2023-11-24T07:57:57.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- start start 2023-11-24T07:57:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb40406dfd0 0x7fb404134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40415b820 con 0x7fb404143ae0 2023-11-24T07:57:57.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404134da0 con 0x7fb40406dfd0 2023-11-24T07:57:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.780+0000 7fb4098c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404140ab0 con 0x7fb4040adcc0 2023-11-24T07:57:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb402ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb40406dfd0 0x7fb404134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:49100/0 (socket says 172.21.15.5:49100) 2023-11-24T07:57:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 -- 172.21.15.5:0/482219612 learned_addr learned my addr 172.21.15.5:0/482219612 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:57.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58238/0 (socket says 172.21.15.5:58238) 2023-11-24T07:57:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 -- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb40406dfd0 msgr2=0x7fb404134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb40406dfd0 0x7fb404134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 -- 172.21.15.5:0/482219612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 msgr2=0x7fb404164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 -- 172.21.15.5:0/482219612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0094d0 con 0x7fb4040adcc0 2023-11-24T07:57:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4037fe640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:57:57.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec01a0c0 tx=0x7fb3ec01acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0aa5f0 con 0x7fb4040adcc0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0b3800 con 0x7fb4040adcc0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0b3b90 con 0x7fb4040adcc0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40409c830 con 0x7fb4040adcc0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40415aef0 con 0x7fb4040adcc0 2023-11-24T07:57:57.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40415b990 con 0x7fb4040adcc0 2023-11-24T07:57:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.784+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3ec0b3cf0 con 0x7fb4040adcc0 2023-11-24T07:57:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.788+0000 7fb400ff9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 0x7fb3e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.788+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3ec0a7070 con 0x7fb4040adcc0 2023-11-24T07:57:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.788+0000 7fb402ffd640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 0x7fb3e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:57.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.788+0000 7fb402ffd640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 0x7fb3e4068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4040af550 tx=0x7fb3f4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:57.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.792+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3ec0ebd80 con 0x7fb4040adcc0 2023-11-24T07:57:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.948+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb40404e850 con 0x7fb4040adcc0 2023-11-24T07:57:57.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb400ff9640 1 -- 172.21.15.5:0/482219612 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb3ec0ef3a0 con 0x7fb4040adcc0 2023-11-24T07:57:57.957 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:57.957 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:57.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 msgr2=0x7fb3e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 0x7fb3e4068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4040af550 tx=0x7fb3f4009060 comp rx=0 tx=0).stop 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 msgr2=0x7fb40409c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec01a0c0 tx=0x7fb3ec01acd0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 shutdown_connections 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb3e4066470 0x7fb3e4068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb404143ae0 0x7fb404164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4040adcc0 0x7fb40409c2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 --2- 172.21.15.5:0/482219612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb40406dfd0 0x7fb404134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 >> 172.21.15.5:0/482219612 conn(0x7fb4040b0c40 msgr2=0x7fb4040b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 shutdown_connections 2023-11-24T07:57:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:57.952+0000 7fb4098c9640 1 -- 172.21.15.5:0/482219612 wait complete. 2023-11-24T07:57:57.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T07:57:41.453701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T07:57:41.884898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:57:57.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:57:58.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 Processor -- start 2023-11-24T07:57:58.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 -- start start 2023-11-24T07:57:58.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef94161f20 0x7fef940cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 0x7fef940cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef940d0740 con 0x7fef9415d7c0 2023-11-24T07:57:58.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef940d0f90 con 0x7fef94161f20 2023-11-24T07:57:58.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9c6e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef940d11a0 con 0x7fef940d02f0 2023-11-24T07:57:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9a47f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef9415d7c0 0x7fef940d3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38420/0 (socket says 172.21.15.5:38420) 2023-11-24T07:57:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9a47f640 1 -- 172.21.15.5:0/117518971 learned_addr learned my addr 172.21.15.5:0/117518971 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef99c7e640 1 --2- 172.21.15.5:0/117518971 >> v2:172.21.15.5:3300/0 conn(0x7fef94161f20 0x7fef940cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9ac80640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 0x7fef940cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9947d640 1 -- 172.21.15.5:0/117518971 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454383595 0 0) 0x7fef90001120 con 0x7fef9415d7c0 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9947d640 1 -- 172.21.15.5:0/117518971 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef80003530 con 0x7fef9415d7c0 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef99c7e640 1 -- 172.21.15.5:0/117518971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 msgr2=0x7fef940cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef99c7e640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 0x7fef940cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef99c7e640 1 -- 172.21.15.5:0/117518971 >> v1:172.21.15.5:6789/0 conn(0x7fef9415d7c0 legacy=0x7fef940d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef99c7e640 1 -- 172.21.15.5:0/117518971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef940d1480 con 0x7fef94161f20 2023-11-24T07:57:58.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.120+0000 7fef9ac80640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 0x7fef940cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:57:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef99c7e640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef94161f20 0x7fef940cfdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef840097a0 tx=0x7fef8401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aa3ee0bf64b196 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9947d640 1 -- 172.21.15.5:0/117518971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef840ac600 con 0x7fef94161f20 2023-11-24T07:57:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9947d640 1 -- 172.21.15.5:0/117518971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef840a8050 con 0x7fef94161f20 2023-11-24T07:57:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9947d640 1 -- 172.21.15.5:0/117518971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef840ac960 con 0x7fef94161f20 2023-11-24T07:57:58.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 -- 172.21.15.5:0/117518971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef94161f20 msgr2=0x7fef940cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef94161f20 0x7fef940cfdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef840097a0 tx=0x7fef8401c3a0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 -- 172.21.15.5:0/117518971 shutdown_connections 2023-11-24T07:57:58.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef940d02f0 0x7fef940cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/117518971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef94161f20 0x7fef940cfdb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 -- 172.21.15.5:0/117518971 >> 172.21.15.5:0/117518971 conn(0x7fef9408afc0 msgr2=0x7fef940d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 -- 172.21.15.5:0/117518971 shutdown_connections 2023-11-24T07:57:58.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.124+0000 7fef9c6e3640 1 -- 172.21.15.5:0/117518971 wait complete. 2023-11-24T07:57:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 Processor -- start 2023-11-24T07:57:58.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- start start 2023-11-24T07:57:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 0x7fef9415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 0x7fef940b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9415ab20 con 0x7fef940d02f0 2023-11-24T07:57:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9415ae00 con 0x7fef9415c4f0 2023-11-24T07:57:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9415b0e0 con 0x7fef9415d7c0 2023-11-24T07:57:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58244/0 (socket says 172.21.15.5:58244) 2023-11-24T07:57:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 -- 172.21.15.5:0/3034076210 learned_addr learned my addr 172.21.15.5:0/3034076210 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef99c7e640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 0x7fef9415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9ac80640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 0x7fef940b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 -- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 msgr2=0x7fef9415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 0x7fef9415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 -- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 msgr2=0x7fef940b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 0x7fef940b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 -- 172.21.15.5:0/3034076210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840093b0 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef99c7e640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 0x7fef9415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9ac80640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 0x7fef940b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9a47f640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef9000c700 tx=0x7fef9000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90005ac0 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90005c60 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90001d60 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9415b3c0 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.128+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9415b6a0 con 0x7fef940d02f0 2023-11-24T07:57:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.132+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9404e850 con 0x7fef940d02f0 2023-11-24T07:57:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.132+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef90007070 con 0x7fef940d02f0 2023-11-24T07:57:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.132+0000 7fef8affd640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 0x7fef78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.132+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef90083100 con 0x7fef940d02f0 2023-11-24T07:57:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.132+0000 7fef99c7e640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 0x7fef78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.136+0000 7fef99c7e640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 0x7fef78068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef840ae000 tx=0x7fef84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.136+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef90050620 con 0x7fef940d02f0 2023-11-24T07:57:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef940d0740 con 0x7fef940d02f0 2023-11-24T07:57:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef8affd640 1 -- 172.21.15.5:0/3034076210 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef940d0740 con 0x7fef940d02f0 2023-11-24T07:57:58.303 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 msgr2=0x7fef78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 0x7fef78068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef840ae000 tx=0x7fef84008040 comp rx=0 tx=0).stop 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 msgr2=0x7fef94155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef9000c700 tx=0x7fef9000cbc0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 shutdown_connections 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef780664a0 0x7fef78068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9415c4f0 0x7fef940b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef9415d7c0 0x7fef9415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 --2- 172.21.15.5:0/3034076210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef940d02f0 0x7fef94155140 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 >> 172.21.15.5:0/3034076210 conn(0x7fef9408afc0 msgr2=0x7fef940cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 shutdown_connections 2023-11-24T07:57:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.300+0000 7fef9c6e3640 1 -- 172.21.15.5:0/3034076210 wait complete. 2023-11-24T07:57:58.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T07:57:58.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 Processor -- start 2023-11-24T07:57:58.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 -- start start 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f562015d7c0 0x7f56200d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5620161f20 0x7f56200cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56200d0740 con 0x7f56200d02f0 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200d0f90 con 0x7f562015d7c0 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f562538d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200d11a0 con 0x7f5620161f20 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f562015d7c0 0x7f56200d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56200d02f0 0x7f562015dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38430/0 (socket says 172.21.15.5:38430) 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561f7fe640 1 -- 172.21.15.5:0/3926731940 learned_addr learned my addr 172.21.15.5:0/3926731940 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f562015d7c0 0x7f56200d3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58250/0 (socket says 172.21.15.5:58250) 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f5617fff640 1 --2- 172.21.15.5:0/3926731940 >> v2:172.21.15.102:3300/0 conn(0x7f5620161f20 0x7f56200cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 -- 172.21.15.5:0/3926731940 >> v2:172.21.15.102:3300/0 conn(0x7f5620161f20 msgr2=0x7f56200cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 --2- 172.21.15.5:0/3926731940 >> v2:172.21.15.102:3300/0 conn(0x7f5620161f20 0x7f56200cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 -- 172.21.15.5:0/3926731940 >> v1:172.21.15.5:6789/0 conn(0x7f56200d02f0 legacy=0x7f562015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561e7fc640 1 -- 172.21.15.5:0/3926731940 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163075253 0 0) 0x7f56180014a0 con 0x7f56200d02f0 2023-11-24T07:57:58.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.468+0000 7f561effd640 1 -- 172.21.15.5:0/3926731940 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200d1480 con 0x7f562015d7c0 2023-11-24T07:57:58.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f561effd640 1 --2- 172.21.15.5:0/3926731940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f562015d7c0 0x7f56200d3d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f56200cd9a0 tx=0x7f561001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edc54676ae22032 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f561e7fc640 1 -- 172.21.15.5:0/3926731940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100ac600 con 0x7f562015d7c0 2023-11-24T07:57:58.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f561e7fc640 1 -- 172.21.15.5:0/3926731940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100a8050 con 0x7f562015d7c0 2023-11-24T07:57:58.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f561e7fc640 1 -- 172.21.15.5:0/3926731940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100ac980 con 0x7f562015d7c0 2023-11-24T07:57:58.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 -- 172.21.15.5:0/3926731940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f562015d7c0 msgr2=0x7f56200d3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 --2- 172.21.15.5:0/3926731940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f562015d7c0 0x7f56200d3d50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f56200cd9a0 tx=0x7f561001c3a0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 -- 172.21.15.5:0/3926731940 shutdown_connections 2023-11-24T07:57:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 --2- 172.21.15.5:0/3926731940 >> v2:172.21.15.102:3300/0 conn(0x7f5620161f20 0x7f56200cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 --2- 172.21.15.5:0/3926731940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f562015d7c0 0x7f56200d3d50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 -- 172.21.15.5:0/3926731940 >> 172.21.15.5:0/3926731940 conn(0x7f562008afc0 msgr2=0x7f56200d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 -- 172.21.15.5:0/3926731940 shutdown_connections 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 -- 172.21.15.5:0/3926731940 wait complete. 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.472+0000 7f562538d640 1 Processor -- start 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- start start 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56200d02f0 0x7f562014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f562015d7c0 0x7f562014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200b6cc0 con 0x7f5620154eb0 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201558a0 con 0x7f56200d02f0 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562014dbf0 con 0x7f562015d7c0 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58262/0 (socket says 172.21.15.5:58262) 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 -- 172.21.15.5:0/876153206 learned_addr learned my addr 172.21.15.5:0/876153206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561effd640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56200d02f0 0x7f562014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f5617fff640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f562015d7c0 0x7f562014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 -- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f562015d7c0 msgr2=0x7f562014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f562015d7c0 0x7f562014d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 -- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56200d02f0 msgr2=0x7f562014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56200d02f0 0x7f562014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 -- 172.21.15.5:0/876153206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009420 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f561f7fe640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f561800c780 tx=0x7f561800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800ce90 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800a640 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56200b6080 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800a9d0 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56200b6600 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.476+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562004e850 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.480+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f561800ab30 con 0x7f5620154eb0 2023-11-24T07:57:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.480+0000 7f56177fe640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 0x7f5600068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.480+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56180833e0 con 0x7f5620154eb0 2023-11-24T07:57:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.480+0000 7f561effd640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 0x7f5600068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.480+0000 7f561effd640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 0x7f5600068980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56100ae000 tx=0x7f56100a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.484+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5618050a80 con 0x7f5620154eb0 2023-11-24T07:57:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.644+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56200d0740 con 0x7f5620154eb0 2023-11-24T07:57:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.644+0000 7f56177fe640 1 -- 172.21.15.5:0/876153206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56200d0740 con 0x7f5620154eb0 2023-11-24T07:57:58.649 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 msgr2=0x7f5600068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 0x7f5600068980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56100ae000 tx=0x7f56100a7000 comp rx=0 tx=0).stop 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 msgr2=0x7f5620155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f561800c780 tx=0x7f561800cc40 comp rx=0 tx=0).stop 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 shutdown_connections 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56000664c0 0x7f5600068980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5620154eb0 0x7f5620155360 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f562015d7c0 0x7f562014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 --2- 172.21.15.5:0/876153206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56200d02f0 0x7f562014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 >> 172.21.15.5:0/876153206 conn(0x7f562008afc0 msgr2=0x7f5620156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 shutdown_connections 2023-11-24T07:57:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.648+0000 7f562538d640 1 -- 172.21.15.5:0/876153206 wait complete. 2023-11-24T07:57:58.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T07:57:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.812+0000 7f9bbf2bb640 1 Processor -- start 2023-11-24T07:57:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.812+0000 7f9bbf2bb640 1 -- start start 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.812+0000 7f9bbf2bb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bb815d2a0 0x7f9bb80d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbf2bb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80b6250 con 0x7f9bb80b5350 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbf2bb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb8161cf0 con 0x7f9bb80d2c20 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbf2bb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80ce8c0 con 0x7f9bb815d2a0 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbe2b9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bb815d2a0 0x7f9bb80d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbeaba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bb80b5350 0x7f9bb80d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38438/0 (socket says 172.21.15.5:38438) 2023-11-24T07:57:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbeaba640 1 -- 172.21.15.5:0/3899128518 learned_addr learned my addr 172.21.15.5:0/3899128518 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3899128518 >> v1:172.21.15.102:6789/0 conn(0x7f9bb80d2c20 legacy=0x7f9bb80b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3899128518 >> v1:172.21.15.5:6789/0 conn(0x7f9bb80b5350 legacy=0x7f9bb80d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3899128518 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8161170 con 0x7f9bb815d2a0 2023-11-24T07:57:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbd2b7640 1 -- 172.21.15.5:0/3899128518 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557148908 0 0) 0x7f9bb80b6250 con 0x7f9bb80b5350 2023-11-24T07:57:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbe2b9640 1 --2- 172.21.15.5:0/3899128518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80d26e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40097c0 tx=0x7f9bb401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082f44348dc8c62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbd2b7640 1 -- 172.21.15.5:0/3899128518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40ab650 con 0x7f9bb815d2a0 2023-11-24T07:57:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbd2b7640 1 -- 172.21.15.5:0/3899128518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40ab7b0 con 0x7f9bb815d2a0 2023-11-24T07:57:58.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.816+0000 7f9bbd2b7640 1 -- 172.21.15.5:0/3899128518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40abb40 con 0x7f9bb815d2a0 2023-11-24T07:57:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3899128518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb815d2a0 msgr2=0x7f9bb80d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3899128518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80d26e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40097c0 tx=0x7f9bb401c450 comp rx=0 tx=0).stop 2023-11-24T07:57:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3899128518 shutdown_connections 2023-11-24T07:57:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3899128518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80d26e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3899128518 >> 172.21.15.5:0/3899128518 conn(0x7f9bb80668a0 msgr2=0x7f9bb80cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3899128518 shutdown_connections 2023-11-24T07:57:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3899128518 wait complete. 2023-11-24T07:57:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 Processor -- start 2023-11-24T07:57:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- start start 2023-11-24T07:57:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bb80d2c20 0x7f9bb8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815e860 con 0x7f9bb80b5350 2023-11-24T07:57:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815dbe0 con 0x7f9bb815d2a0 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbf2bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815dec0 con 0x7f9bb80d2c20 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbe2b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbe2b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58288/0 (socket says 172.21.15.5:58288) 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3938474619 learned_addr learned my addr 172.21.15.5:0/3938474619 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbdab8640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bb80d2c20 0x7f9bb8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.820+0000 7f9bbeaba640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bb80d2c20 msgr2=0x7f9bb8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bb80d2c20 0x7f9bb8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bb815d2a0 msgr2=0x7f9bb80cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 -- 172.21.15.5:0/3938474619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009420 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbe2b9640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ad040 tx=0x7f9bb401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b5810 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40b5970 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb815e1a0 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b5d20 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb815d800 con 0x7f9bb80b5350 2023-11-24T07:57:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8074990 con 0x7f9bb80b5350 2023-11-24T07:57:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bb40bf410 con 0x7f9bb80b5350 2023-11-24T07:57:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 0x7f9b9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.824+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb411f0a0 con 0x7f9bb80b5350 2023-11-24T07:57:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.828+0000 7f9bbdab8640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 0x7f9b9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.828+0000 7f9bbdab8640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 0x7f9b9c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.828+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bb40ec6e0 con 0x7f9bb80b5350 2023-11-24T07:57:58.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bb80d1260 con 0x7f9bb80b5350 2023-11-24T07:57:58.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9baeffd640 1 -- 172.21.15.5:0/3938474619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bb40c40a0 con 0x7f9bb80b5350 2023-11-24T07:57:58.990 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-11-24T07:57:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 msgr2=0x7f9b9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 0x7f9b9c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).stop 2023-11-24T07:57:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 msgr2=0x7f9bb8154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ad040 tx=0x7f9bb401ac90 comp rx=0 tx=0).stop 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 shutdown_connections 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9b9c066470 0x7f9b9c068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bb815d2a0 0x7f9bb80cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bb80d2c20 0x7f9bb8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 --2- 172.21.15.5:0/3938474619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bb80b5350 0x7f9bb8154ef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 >> 172.21.15.5:0/3938474619 conn(0x7f9bb80668a0 msgr2=0x7f9bb80d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 shutdown_connections 2023-11-24T07:57:58.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:58.988+0000 7f9bbf2bb640 1 -- 172.21.15.5:0/3938474619 wait complete. 2023-11-24T07:57:59.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:59.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.152+0000 7f9a21365640 1 Processor -- start 2023-11-24T07:57:59.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.152+0000 7f9a21365640 1 -- start start 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a21365640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a1c144c80 0x7f9a1c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a21365640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c145060 con 0x7f9a1c0ac460 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a21365640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c071fd0 con 0x7f9a1c070df0 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a21365640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0ac8c0 con 0x7f9a1c144c80 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a1c144c80 0x7f9a1c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a1c144c80 0x7f9a1c0abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58290/0 (socket says 172.21.15.5:58290) 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 -- 172.21.15.5:0/608255679 learned_addr learned my addr 172.21.15.5:0/608255679 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:59.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a13fff640 1 --1- 172.21.15.5:0/608255679 >> v1:172.21.15.5:6789/0 conn(0x7f9a1c0ac460 0x7f9a1c0706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38454/0 (socket says 172.21.15.5:38454) 2023-11-24T07:57:59.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 -- 172.21.15.5:0/608255679 >> v1:172.21.15.102:6789/0 conn(0x7f9a1c070df0 legacy=0x7f9a1c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 -- 172.21.15.5:0/608255679 >> v1:172.21.15.5:6789/0 conn(0x7f9a1c0ac460 legacy=0x7f9a1c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.156+0000 7f9a1affd640 1 -- 172.21.15.5:0/608255679 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c071450 con 0x7f9a1c144c80 2023-11-24T07:57:59.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a1affd640 1 --2- 172.21.15.5:0/608255679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c0abf20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009870 tx=0x7f9a0c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301e42d964f55407 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a1a7fc640 1 -- 172.21.15.5:0/608255679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0a7070 con 0x7f9a1c144c80 2023-11-24T07:57:59.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a1a7fc640 1 -- 172.21.15.5:0/608255679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0ab430 con 0x7f9a1c144c80 2023-11-24T07:57:59.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a1a7fc640 1 -- 172.21.15.5:0/608255679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0ab7c0 con 0x7f9a1c144c80 2023-11-24T07:57:59.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- 172.21.15.5:0/608255679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 msgr2=0x7f9a1c0abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 --2- 172.21.15.5:0/608255679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c0abf20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009870 tx=0x7f9a0c01c540 comp rx=0 tx=0).stop 2023-11-24T07:57:59.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- 172.21.15.5:0/608255679 shutdown_connections 2023-11-24T07:57:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 --2- 172.21.15.5:0/608255679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c0abf20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- 172.21.15.5:0/608255679 >> 172.21.15.5:0/608255679 conn(0x7f9a1c0b0c40 msgr2=0x7f9a1c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- 172.21.15.5:0/608255679 shutdown_connections 2023-11-24T07:57:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- 172.21.15.5:0/608255679 wait complete. 2023-11-24T07:57:59.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 Processor -- start 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.160+0000 7f9a21365640 1 -- start start 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 0x7f9a1c09b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a1c0ac460 0x7f9a1c09be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c09b760 con 0x7f9a1c144c80 2023-11-24T07:57:59.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1f64d0 con 0x7f9a1c070df0 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1f67b0 con 0x7f9a1c0ac460 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 0x7f9a1c09b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58304/0 (socket says 172.21.15.5:58304) 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 0x7f9a1c09b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:55206/0 (socket says 172.21.15.5:55206) 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 -- 172.21.15.5:0/3761748155 learned_addr learned my addr 172.21.15.5:0/3761748155 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:59.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a13fff640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a1c0ac460 0x7f9a1c09be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 -- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a1c0ac460 msgr2=0x7f9a1c09be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a1c0ac460 0x7f9a1c09be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 -- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 msgr2=0x7f9a1c09b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 0x7f9a1c09b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 -- 172.21.15.5:0/3761748155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0094d0 con 0x7f9a1c144c80 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a1b7fe640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c730 tx=0x7f9a1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003b80 con 0x7f9a1c144c80 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14003ce0 con 0x7f9a1c144c80 2023-11-24T07:57:59.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400aa30 con 0x7f9a1c144c80 2023-11-24T07:57:59.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c1f6a90 con 0x7f9a1c144c80 2023-11-24T07:57:59.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c1f7050 con 0x7f9a1c144c80 2023-11-24T07:57:59.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c0b1ba0 con 0x7f9a1c144c80 2023-11-24T07:57:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.164+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a1400ab90 con 0x7f9a1c144c80 2023-11-24T07:57:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.168+0000 7f9a137fe640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 0x7f99fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.168+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a14083a70 con 0x7f9a1c144c80 2023-11-24T07:57:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.168+0000 7f9a1affd640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 0x7f99fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.168+0000 7f9a1affd640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 0x7f99fc068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0af000 tx=0x7f9a0c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.172+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a14051030 con 0x7f9a1c144c80 2023-11-24T07:57:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.364+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1c04e850 con 0x7f9a1c144c80 2023-11-24T07:57:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.364+0000 7f9a137fe640 1 -- 172.21.15.5:0/3761748155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9a14054650 con 0x7f9a1c144c80 2023-11-24T07:57:59.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:59.368 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:57:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-11-24T07:57:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 msgr2=0x7f99fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 0x7f99fc068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0af000 tx=0x7f9a0c0b6040 comp rx=0 tx=0).stop 2023-11-24T07:57:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 msgr2=0x7f9a1c09c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c730 tx=0x7f9a1400cbf0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 shutdown_connections 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f99fc066470 0x7f99fc068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a1c144c80 0x7f9a1c09c380 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a1c0ac460 0x7f9a1c09be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 --2- 172.21.15.5:0/3761748155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a1c070df0 0x7f9a1c09b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 >> 172.21.15.5:0/3761748155 conn(0x7f9a1c0b0c40 msgr2=0x7f9a1c0aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 shutdown_connections 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.368+0000 7f9a21365640 1 -- 172.21.15.5:0/3761748155 wait complete. 2023-11-24T07:57:59.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:57:59.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 Processor -- start 2023-11-24T07:57:59.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 -- start start 2023-11-24T07:57:59.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 0x7fae280b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae280d3740 0x7fae280d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280b6cb0 con 0x7fae28161310 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280b9290 con 0x7fae280d3740 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae2d2d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280d4110 con 0x7fae2815d7a0 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae280d3740 0x7fae280d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae26ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 0x7fae280b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae280d3740 0x7fae280d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58308/0 (socket says 172.21.15.5:58308) 2023-11-24T07:57:59.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae26ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 0x7fae280b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:55210/0 (socket says 172.21.15.5:55210) 2023-11-24T07:57:59.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 -- 172.21.15.5:0/3495691905 learned_addr learned my addr 172.21.15.5:0/3495691905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:59.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae267fc640 1 --1- 172.21.15.5:0/3495691905 >> v1:172.21.15.102:6789/0 conn(0x7fae28161310 0x7fae280ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:41416/0 (socket says 172.21.15.5:41416) 2023-11-24T07:57:59.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 -- 172.21.15.5:0/3495691905 >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 msgr2=0x7fae280b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:59.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 --2- 172.21.15.5:0/3495691905 >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 0x7fae280b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 -- 172.21.15.5:0/3495691905 >> v1:172.21.15.102:6789/0 conn(0x7fae28161310 legacy=0x7fae280ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae277fe640 1 -- 172.21.15.5:0/3495691905 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28161890 con 0x7fae280d3740 2023-11-24T07:57:59.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.532+0000 7fae25ffb640 1 -- 172.21.15.5:0/3495691905 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230814262 0 0) 0x7fae280b6cb0 con 0x7fae28161310 2023-11-24T07:57:59.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae277fe640 1 --2- 172.21.15.5:0/3495691905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae280d3740 0x7fae280d3bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae280b5e90 tx=0x7fae2001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f50a7f45345193 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae25ffb640 1 -- 172.21.15.5:0/3495691905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200a5860 con 0x7fae280d3740 2023-11-24T07:57:59.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae25ffb640 1 -- 172.21.15.5:0/3495691905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae200a59c0 con 0x7fae280d3740 2023-11-24T07:57:59.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae25ffb640 1 -- 172.21.15.5:0/3495691905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200a5d50 con 0x7fae280d3740 2023-11-24T07:57:59.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3495691905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae280d3740 msgr2=0x7fae280d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3495691905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae280d3740 0x7fae280d3bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae280b5e90 tx=0x7fae2001c9a0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3495691905 shutdown_connections 2023-11-24T07:57:59.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3495691905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae280d3740 0x7fae280d3bd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3495691905 >> v2:172.21.15.102:3300/0 conn(0x7fae2815d7a0 0x7fae280b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3495691905 >> 172.21.15.5:0/3495691905 conn(0x7fae2806b9f0 msgr2=0x7fae2806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:59.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3495691905 shutdown_connections 2023-11-24T07:57:59.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.536+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3495691905 wait complete. 2023-11-24T07:57:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 Processor -- start 2023-11-24T07:57:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- start start 2023-11-24T07:57:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae280d3740 0x7fae281527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae28161310 0x7fae281567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28152eb0 con 0x7fae2815d7a0 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28152d30 con 0x7fae280d3740 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae28153ca0 con 0x7fae28161310 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58316/0 (socket says 172.21.15.5:58316) 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 -- 172.21.15.5:0/3947106421 learned_addr learned my addr 172.21.15.5:0/3947106421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 -- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae28161310 msgr2=0x7fae281567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae28161310 0x7fae281567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 -- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae280d3740 msgr2=0x7fae281527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae280d3740 0x7fae281527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 -- 172.21.15.5:0/3947106421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20009b30 con 0x7fae2815d7a0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae267fc640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c410 tx=0x7fae1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0074e0 con 0x7fae2815d7a0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c007660 con 0x7fae2815d7a0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c004a30 con 0x7fae2815d7a0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae28154730 con 0x7fae2815d7a0 2023-11-24T07:57:59.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.540+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28153370 con 0x7fae2815d7a0 2023-11-24T07:57:59.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae28074a00 con 0x7fae2815d7a0 2023-11-24T07:57:59.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae1c004b90 con 0x7fae2815d7a0 2023-11-24T07:57:59.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae0f7fe640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 0x7fae140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae1c0837f0 con 0x7fae2815d7a0 2023-11-24T07:57:59.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae26ffd640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 0x7fae140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.544+0000 7fae26ffd640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 0x7fae140689b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fae18006aa0 tx=0x7fae18006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.548+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae1c050ce0 con 0x7fae2815d7a0 2023-11-24T07:57:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.708+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae28153de0 con 0x7fae2815d7a0 2023-11-24T07:57:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.708+0000 7fae0f7fe640 1 -- 172.21.15.5:0/3947106421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fae1c054300 con 0x7fae2815d7a0 2023-11-24T07:57:59.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:57:59.713 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:57:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 msgr2=0x7fae140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 0x7fae140689b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fae18006aa0 tx=0x7fae18006a30 comp rx=0 tx=0).stop 2023-11-24T07:57:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 msgr2=0x7fae28156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c410 tx=0x7fae1c00c8d0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 shutdown_connections 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fae140664f0 0x7fae140689b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae28161310 0x7fae281567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2815d7a0 0x7fae28156260 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 --2- 172.21.15.5:0/3947106421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae280d3740 0x7fae281527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 >> 172.21.15.5:0/3947106421 conn(0x7fae2806b9f0 msgr2=0x7fae280c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 shutdown_connections 2023-11-24T07:57:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.712+0000 7fae2d2d6640 1 -- 172.21.15.5:0/3947106421 wait complete. 2023-11-24T07:57:59.735 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T07:57:59.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:57:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 Processor -- start 2023-11-24T07:57:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 -- start start 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46a006dfd0 0x7f46a006e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f46a00adcc0 0x7f46a00ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a006e980 con 0x7f46a0143ae0 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0070670 con 0x7f46a006dfd0 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f46a5ae4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0070950 con 0x7f46a00adcc0 2023-11-24T07:57:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46a006dfd0 0x7f46a006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46a0143ae0 0x7f46a00b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38464/0 (socket says 172.21.15.5:38464) 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469f7fe640 1 -- 172.21.15.5:0/834612780 learned_addr learned my addr 172.21.15.5:0/834612780 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469ffff640 1 --2- 172.21.15.5:0/834612780 >> v2:172.21.15.102:3300/0 conn(0x7f46a00adcc0 0x7f46a00ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469effd640 1 -- 172.21.15.5:0/834612780 >> v2:172.21.15.102:3300/0 conn(0x7f46a00adcc0 msgr2=0x7f46a00ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469effd640 1 --2- 172.21.15.5:0/834612780 >> v2:172.21.15.102:3300/0 conn(0x7f46a00adcc0 0x7f46a00ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469effd640 1 -- 172.21.15.5:0/834612780 >> v1:172.21.15.5:6789/0 conn(0x7f46a0143ae0 legacy=0x7f46a00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.876+0000 7f469effd640 1 -- 172.21.15.5:0/834612780 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0070c30 con 0x7f46a006dfd0 2023-11-24T07:57:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f469effd640 1 --2- 172.21.15.5:0/834612780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a006e440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a0072ad0 tx=0x7f469401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61175d350574bc28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f469e7fc640 1 -- 172.21.15.5:0/834612780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940a7070 con 0x7f46a006dfd0 2023-11-24T07:57:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f469e7fc640 1 -- 172.21.15.5:0/834612780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46940ab430 con 0x7f46a006dfd0 2023-11-24T07:57:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f469e7fc640 1 -- 172.21.15.5:0/834612780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940ab7c0 con 0x7f46a006dfd0 2023-11-24T07:57:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 -- 172.21.15.5:0/834612780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 msgr2=0x7f46a006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/834612780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a006e440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a0072ad0 tx=0x7f469401c430 comp rx=0 tx=0).stop 2023-11-24T07:57:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 -- 172.21.15.5:0/834612780 shutdown_connections 2023-11-24T07:57:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/834612780 >> v2:172.21.15.102:3300/0 conn(0x7f46a00adcc0 0x7f46a00ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/834612780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a006e440 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 -- 172.21.15.5:0/834612780 >> 172.21.15.5:0/834612780 conn(0x7f46a00b0c40 msgr2=0x7f46a00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:57:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 -- 172.21.15.5:0/834612780 shutdown_connections 2023-11-24T07:57:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.880+0000 7f46a5ae4640 1 -- 172.21.15.5:0/834612780 wait complete. 2023-11-24T07:57:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 Processor -- start 2023-11-24T07:57:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- start start 2023-11-24T07:57:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46a00adcc0 0x7f46a009b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46a0143ae0 0x7f46a009b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a013a230 con 0x7f46a006dfd0 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a013e9b0 con 0x7f46a0143ae0 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a013ec90 con 0x7f46a00adcc0 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58322/0 (socket says 172.21.15.5:58322) 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 -- 172.21.15.5:0/1540010350 learned_addr learned my addr 172.21.15.5:0/1540010350 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:57:59.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469effd640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46a00adcc0 0x7f46a009b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469ffff640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46a0143ae0 0x7f46a009b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 -- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46a00adcc0 msgr2=0x7f46a009b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46a00adcc0 0x7f46a009b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 -- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46a0143ae0 msgr2=0x7f46a009b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:57:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46a0143ae0 0x7f46a009b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:57:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 -- 172.21.15.5:0/1540010350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009420 con 0x7f46a006dfd0 2023-11-24T07:57:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f469f7fe640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f469000c400 tx=0x7f469000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690005cf0 con 0x7f46a006dfd0 2023-11-24T07:57:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690005e50 con 0x7f46a006dfd0 2023-11-24T07:57:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900072d0 con 0x7f46a006dfd0 2023-11-24T07:57:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a009a930 con 0x7f46a006dfd0 2023-11-24T07:57:59.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.884+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a009aef0 con 0x7f46a006dfd0 2023-11-24T07:57:59.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a004e850 con 0x7f46a006dfd0 2023-11-24T07:57:59.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4690007430 con 0x7f46a006dfd0 2023-11-24T07:57:59.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f4687fff640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 0x7f468c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:57:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4690083350 con 0x7f46a006dfd0 2023-11-24T07:57:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f469effd640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 0x7f468c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:57:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.888+0000 7f469effd640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 0x7f468c068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46940af000 tx=0x7f46940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:57:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:57:59.892+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4690050870 con 0x7f46a006dfd0 2023-11-24T07:58:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46a006cc40 con 0x7f46a006dfd0 2023-11-24T07:58:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f4687fff640 1 -- 172.21.15.5:0/1540010350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4690053e90 con 0x7f46a006dfd0 2023-11-24T07:58:00.084 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:00.084 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:58:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-11-24T07:58:00.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 msgr2=0x7f468c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 0x7f468c068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46940af000 tx=0x7f46940a7000 comp rx=0 tx=0).stop 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 msgr2=0x7f46a0139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f469000c400 tx=0x7f469000c8c0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 shutdown_connections 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f468c066470 0x7f468c068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46a0143ae0 0x7f46a009b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46a00adcc0 0x7f46a009b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 --2- 172.21.15.5:0/1540010350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46a006dfd0 0x7f46a0139cf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 >> 172.21.15.5:0/1540010350 conn(0x7f46a00b0c40 msgr2=0x7f46a00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.080+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 shutdown_connections 2023-11-24T07:58:00.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.084+0000 7f46a5ae4640 1 -- 172.21.15.5:0/1540010350 wait complete. 2023-11-24T07:58:00.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:58:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 Processor -- start 2023-11-24T07:58:00.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 -- start start 2023-11-24T07:58:00.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c9815a4c0 0x7f9c980b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980cf6e0 0x7f9c980b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980b05d0 con 0x7f9c980b3590 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980af9c0 con 0x7f9c9815a4c0 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.244+0000 7f9ca0757640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980b1b20 con 0x7f9c980cf6e0 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c9815a4c0 0x7f9c980b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c9815a4c0 0x7f9c980b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58336/0 (socket says 172.21.15.5:58336) 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 -- 172.21.15.5:0/3732991953 learned_addr learned my addr 172.21.15.5:0/3732991953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9dcf2640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980cf6e0 0x7f9c980b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 -- 172.21.15.5:0/3732991953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980cf6e0 msgr2=0x7f9c980b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980cf6e0 0x7f9c980b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 -- 172.21.15.5:0/3732991953 >> v1:172.21.15.102:6789/0 conn(0x7f9c980b3590 legacy=0x7f9c980ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 -- 172.21.15.5:0/3732991953 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b0820 con 0x7f9c9815a4c0 2023-11-24T07:58:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9e4f3640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c9815a4c0 0x7f9c980b15e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009870 tx=0x7f9c9401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986662c6f226ca64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9d4f1640 1 -- 172.21.15.5:0/3732991953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940aa670 con 0x7f9c9815a4c0 2023-11-24T07:58:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9d4f1640 1 -- 172.21.15.5:0/3732991953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940aa7d0 con 0x7f9c9815a4c0 2023-11-24T07:58:00.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.248+0000 7f9c9d4f1640 1 -- 172.21.15.5:0/3732991953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940aab60 con 0x7f9c9815a4c0 2023-11-24T07:58:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- 172.21.15.5:0/3732991953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c9815a4c0 msgr2=0x7f9c980b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c9815a4c0 0x7f9c980b15e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009870 tx=0x7f9c9401c510 comp rx=0 tx=0).stop 2023-11-24T07:58:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- 172.21.15.5:0/3732991953 shutdown_connections 2023-11-24T07:58:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980cf6e0 0x7f9c980b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- 172.21.15.5:0/3732991953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c9815a4c0 0x7f9c980b15e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- 172.21.15.5:0/3732991953 >> 172.21.15.5:0/3732991953 conn(0x7f9c980b5570 msgr2=0x7f9c980b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- 172.21.15.5:0/3732991953 shutdown_connections 2023-11-24T07:58:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- 172.21.15.5:0/3732991953 wait complete. 2023-11-24T07:58:00.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 Processor -- start 2023-11-24T07:58:00.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- start start 2023-11-24T07:58:00.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980b3590 0x7f9c9814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 0x7f9c981f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980ad6e0 con 0x7f9c980cf6e0 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980aef00 con 0x7f9c9815a4c0 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9ca0757640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98150850 con 0x7f9c980b3590 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58342/0 (socket says 172.21.15.5:58342) 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 -- 172.21.15.5:0/2332967810 learned_addr learned my addr 172.21.15.5:0/2332967810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9e4f3640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980b3590 0x7f9c9814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9ecf4640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 0x7f9c981f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 -- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980b3590 msgr2=0x7f9c9814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980b3590 0x7f9c9814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 -- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 msgr2=0x7f9c981f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 0x7f9c981f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9dcf2640 1 -- 172.21.15.5:0/2332967810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940094d0 con 0x7f9c980cf6e0 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.252+0000 7f9c9ecf4640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 0x7f9c981f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:00.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c9dcf2640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800d800 tx=0x7f9c8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800b6c0 con 0x7f9c980cf6e0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800b820 con 0x7f9c980cf6e0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800bb90 con 0x7f9c980cf6e0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980af180 con 0x7f9c980cf6e0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980ad370 con 0x7f9c980cf6e0 2023-11-24T07:58:00.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c980ad890 con 0x7f9c980cf6e0 2023-11-24T07:58:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c8800bcf0 con 0x7f9c980cf6e0 2023-11-24T07:58:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 0x7f9c7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c88084310 con 0x7f9c980cf6e0 2023-11-24T07:58:00.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.256+0000 7f9c9e4f3640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 0x7f9c7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.260+0000 7f9c9e4f3640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 0x7f9c7c068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c940ae000 tx=0x7f9c940b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.260+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c980ad890 con 0x7f9c980cf6e0 2023-11-24T07:58:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.448+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c9804e850 con 0x7f9c980cf6e0 2023-11-24T07:58:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.448+0000 7f9c8effd640 1 -- 172.21.15.5:0/2332967810 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9c88055210 con 0x7f9c980cf6e0 2023-11-24T07:58:00.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:00.454 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T07:57:42.886645+0000","modified":"2023-11-24T07:57:45.915498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5091":{"gid":5091,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1586527042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1586527042},{"type":"v1","addr":"172.21.15.5:6835","nonce":1586527042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T07:58:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-11-24T07:58:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 msgr2=0x7f9c7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 0x7f9c7c068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c940ae000 tx=0x7f9c940b5040 comp rx=0 tx=0).stop 2023-11-24T07:58:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 msgr2=0x7f9c98151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800d800 tx=0x7f9c8800dcc0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 shutdown_connections 2023-11-24T07:58:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9c7c066470 0x7f9c7c068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c9815a4c0 0x7f9c981f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c980cf6e0 0x7f9c98151690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 --2- 172.21.15.5:0/2332967810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c980b3590 0x7f9c9814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 >> 172.21.15.5:0/2332967810 conn(0x7f9c980b5570 msgr2=0x7f9c980b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 shutdown_connections 2023-11-24T07:58:00.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.452+0000 7f9ca0757640 1 -- 172.21.15.5:0/2332967810 wait complete. 2023-11-24T07:58:00.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:58:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 Processor -- start 2023-11-24T07:58:00.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 -- start start 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 0x7f27a00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a00cead0 0x7f27a00d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00d2300 con 0x7f27a00cead0 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00cefd0 con 0x7f27a015d7b0 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f27a5bf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cf2b0 con 0x7f27a00d1eb0 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a00cead0 0x7f27a00d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a00cead0 0x7f27a00d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58354/0 (socket says 172.21.15.5:58354) 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 -- 172.21.15.5:0/2608436218 learned_addr learned my addr 172.21.15.5:0/2608436218 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279f7fe640 1 --2- 172.21.15.5:0/2608436218 >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 0x7f27a00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279ffff640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 -- 172.21.15.5:0/2608436218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 msgr2=0x7f27a00cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 -- 172.21.15.5:0/2608436218 >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 msgr2=0x7f27a00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:00.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 --2- 172.21.15.5:0/2608436218 >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 0x7f27a00d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279effd640 1 -- 172.21.15.5:0/2608436218 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a006b3f0 con 0x7f27a00cead0 2023-11-24T07:58:00.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.616+0000 7f279f7fe640 1 --2- 172.21.15.5:0/2608436218 >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 0x7f27a00d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f279effd640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a00d1970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f27a00d3310 tx=0x7f279401c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0856367e8700862 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f279e7fc640 1 -- 172.21.15.5:0/2608436218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27940ab600 con 0x7f27a00cead0 2023-11-24T07:58:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f279e7fc640 1 -- 172.21.15.5:0/2608436218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27940a7050 con 0x7f27a00cead0 2023-11-24T07:58:00.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f279e7fc640 1 -- 172.21.15.5:0/2608436218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27940ab980 con 0x7f27a00cead0 2023-11-24T07:58:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 -- 172.21.15.5:0/2608436218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 msgr2=0x7f27a00d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a00d1970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f27a00d3310 tx=0x7f279401c0f0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 -- 172.21.15.5:0/2608436218 shutdown_connections 2023-11-24T07:58:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/2608436218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a00d1970 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/2608436218 >> v2:172.21.15.102:3300/0 conn(0x7f27a015d7b0 0x7f27a00d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 -- 172.21.15.5:0/2608436218 >> 172.21.15.5:0/2608436218 conn(0x7f27a00d33b0 msgr2=0x7f27a00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 -- 172.21.15.5:0/2608436218 shutdown_connections 2023-11-24T07:58:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 -- 172.21.15.5:0/2608436218 wait complete. 2023-11-24T07:58:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.620+0000 7f27a5bf5640 1 Processor -- start 2023-11-24T07:58:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- start start 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a015d7b0 0x7f27a00cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0154e90 con 0x7f27a00cead0 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c83a0 con 0x7f27a015d7b0 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c8680 con 0x7f27a00d1eb0 2023-11-24T07:58:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58364/0 (socket says 172.21.15.5:58364) 2023-11-24T07:58:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 -- 172.21.15.5:0/1417914660 learned_addr learned my addr 172.21.15.5:0/1417914660 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279ffff640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a015d7b0 0x7f27a00cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279effd640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 -- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 msgr2=0x7f27a00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 -- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a015d7b0 msgr2=0x7f27a00cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a015d7b0 0x7f27a00cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 -- 172.21.15.5:0/1417914660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27940094d0 con 0x7f27a00cead0 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f279f7fe640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f279000d800 tx=0x7f279000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000b6c0 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279000b820 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000bbd0 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a00c8960 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00ca940 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.624+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00cacb0 con 0x7f27a00cead0 2023-11-24T07:58:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.628+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f279000bd30 con 0x7f27a00cead0 2023-11-24T07:58:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.628+0000 7f2787fff640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.628+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2790084390 con 0x7f27a00cead0 2023-11-24T07:58:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.628+0000 7f279effd640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.628+0000 7f279effd640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 0x7f278c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f27940ad000 tx=0x7f2794008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.632+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2790051800 con 0x7f27a00cead0 2023-11-24T07:58:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.788+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27a00caad0 con 0x7f27a00cead0 2023-11-24T07:58:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.788+0000 7f2787fff640 1 -- 172.21.15.5:0/1417914660 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f2790054e20 con 0x7f27a00cead0 2023-11-24T07:58:00.793 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:00.793 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:57:44.500891+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T07:57:41.453701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T07:57:41.884898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:58:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 msgr2=0x7f278c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 0x7f278c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f27940ad000 tx=0x7f2794008040 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 msgr2=0x7f27a0154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f279000d800 tx=0x7f279000dcc0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 shutdown_connections 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a015d7b0 0x7f27a00cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a00d1eb0 0x7f27a00cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 --2- 172.21.15.5:0/1417914660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a00cead0 0x7f27a0154950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 >> 172.21.15.5:0/1417914660 conn(0x7f27a00d33b0 msgr2=0x7f27a0159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 shutdown_connections 2023-11-24T07:58:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.792+0000 7f27a5bf5640 1 -- 172.21.15.5:0/1417914660 wait complete. 2023-11-24T07:58:00.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T07:58:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 Processor -- start 2023-11-24T07:58:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 -- start start 2023-11-24T07:58:00.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15d8f0 0x7f2d0c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2d0c0cf1b0 0x7f2d0c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0d4420 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c15ecc0 con 0x7f2d0c0cf1b0 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d10daa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0cdfb0 con 0x7f2d0c0ced30 2023-11-24T07:58:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15d8f0 0x7f2d0c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d0c15d8f0 0x7f2d0c15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58380/0 (socket says 172.21.15.5:58380) 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 -- 172.21.15.5:0/2410760571 learned_addr learned my addr 172.21.15.5:0/2410760571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d03fff640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0ad9d640 1 --2- 172.21.15.5:0/2410760571 >> v2:172.21.15.102:3300/0 conn(0x7f2d0c0cf1b0 0x7f2d0c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 -- 172.21.15.5:0/2410760571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 msgr2=0x7f2d0c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 -- 172.21.15.5:0/2410760571 >> v2:172.21.15.102:3300/0 conn(0x7f2d0c0cf1b0 msgr2=0x7f2d0c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/2410760571 >> v2:172.21.15.102:3300/0 conn(0x7f2d0c0cf1b0 0x7f2d0c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.956+0000 7f2d0a59c640 1 -- 172.21.15.5:0/2410760571 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0d4140 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c15e780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0b21f0 tx=0x7f2cfc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913315869cca6cdc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d09d9b640 1 -- 172.21.15.5:0/2410760571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0aa5f0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d09d9b640 1 -- 172.21.15.5:0/2410760571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0aa750 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d09d9b640 1 -- 172.21.15.5:0/2410760571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0aaae0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 -- 172.21.15.5:0/2410760571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 msgr2=0x7f2d0c15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c15e780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0b21f0 tx=0x7f2cfc01c4d0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 -- 172.21.15.5:0/2410760571 shutdown_connections 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 --2- 172.21.15.5:0/2410760571 >> v2:172.21.15.102:3300/0 conn(0x7f2d0c0cf1b0 0x7f2d0c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 --2- 172.21.15.5:0/2410760571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c15e780 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 -- 172.21.15.5:0/2410760571 >> 172.21.15.5:0/2410760571 conn(0x7f2d0c09c750 msgr2=0x7f2d0c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 -- 172.21.15.5:0/2410760571 shutdown_connections 2023-11-24T07:58:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.960+0000 7f2d10daa640 1 -- 172.21.15.5:0/2410760571 wait complete. 2023-11-24T07:58:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 Processor -- start 2023-11-24T07:58:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 -- start start 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d0c0cf1b0 0x7f2d0c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b66b0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b6900 con 0x7f2d0c0cf1b0 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d10daa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b6be0 con 0x7f2d0c0ced30 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:49254/0 (socket says 172.21.15.5:49254) 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0a59c640 1 -- 172.21.15.5:0/3021644294 learned_addr learned my addr 172.21.15.5:0/3021644294 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58392/0 (socket says 172.21.15.5:58392) 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d03fff640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d0c0cf1b0 0x7f2d0c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 -- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 msgr2=0x7f2d0c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 -- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d0c0cf1b0 msgr2=0x7f2d0c155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d0c0cf1b0 0x7f2d0c155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 -- 172.21.15.5:0/3021644294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0094d0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.964+0000 7f2d0ad9d640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007cf0 tx=0x7f2d0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04018070 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400edd0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003bc0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c0b6ec0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c1549c0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c0b73e0 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d04014420 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 0x7f2cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d04083e50 con 0x7f2d0c15d8f0 2023-11-24T07:58:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.968+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 0x7f2cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.972+0000 7f2d0a59c640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 0x7f2cec068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc01c510 tx=0x7f2cfc0b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:00.972+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d0c0b73e0 con 0x7f2d0c15d8f0 2023-11-24T07:58:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.168+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d0c0b73e0 con 0x7f2d0c15d8f0 2023-11-24T07:58:01.171 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-11-24T07:58:01.168+0000 7f60226ed640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T07:58:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.168+0000 7f2d02ffd640 1 -- 172.21.15.5:0/3021644294 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d0c0b73e0 con 0x7f2d0c15d8f0 2023-11-24T07:58:01.173 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T07:58:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 msgr2=0x7f2cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 0x7f2cec068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc01c510 tx=0x7f2cfc0b5040 comp rx=0 tx=0).stop 2023-11-24T07:58:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 msgr2=0x7f2d0c0b76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007cf0 tx=0x7f2d0400e4b0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 shutdown_connections 2023-11-24T07:58:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2cec066470 0x7f2cec068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d0c15d8f0 0x7f2d0c0b76c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d0c0cf1b0 0x7f2d0c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 --2- 172.21.15.5:0/3021644294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d0c0ced30 0x7f2d0c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 >> 172.21.15.5:0/3021644294 conn(0x7f2d0c09c750 msgr2=0x7f2d0c0b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 shutdown_connections 2023-11-24T07:58:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.172+0000 7f2d10daa640 1 -- 172.21.15.5:0/3021644294 wait complete. 2023-11-24T07:58:01.182 INFO:tasks.ceph.mds.a.smithi005.stderr: -2003> 2023-11-24T07:57:46.477+0000 7f05778ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T07:58:01.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T07:58:01.232 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-11-24T07:58:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 Processor -- start 2023-11-24T07:58:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 -- start start 2023-11-24T07:58:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44940cdfb0 0x7f44940abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f449415a710 0x7f44940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cbd50 0x7f44940cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940cca80 con 0x7f44940cdfb0 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940ce8d0 con 0x7f449415a710 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4499735640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b2710 con 0x7f44940cbd50 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44940cdfb0 0x7f44940abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44940cdfb0 0x7f44940abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58414/0 (socket says 172.21.15.5:58414) 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 -- 172.21.15.5:0/3717135128 learned_addr learned my addr 172.21.15.5:0/3717135128 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f448bfff640 1 --2- 172.21.15.5:0/3717135128 >> v2:172.21.15.102:3300/0 conn(0x7f449415a710 0x7f44940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f44937fe640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cbd50 0x7f44940cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 -- 172.21.15.5:0/3717135128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cbd50 msgr2=0x7f44940cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cbd50 0x7f44940cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 -- 172.21.15.5:0/3717135128 >> v2:172.21.15.102:3300/0 conn(0x7f449415a710 msgr2=0x7f44940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 --2- 172.21.15.5:0/3717135128 >> v2:172.21.15.102:3300/0 conn(0x7f449415a710 0x7f44940ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.348+0000 7f4492ffd640 1 -- 172.21.15.5:0/3717135128 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940b29f0 con 0x7f44940cdfb0 2023-11-24T07:58:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4492ffd640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cdfb0 0x7f44940abf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f44940d0040 tx=0x7f448401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8775e170fa725428 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f44927fc640 1 -- 172.21.15.5:0/3717135128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a7c30 con 0x7f44940cdfb0 2023-11-24T07:58:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f44927fc640 1 -- 172.21.15.5:0/3717135128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840a7d90 con 0x7f44940cdfb0 2023-11-24T07:58:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f44927fc640 1 -- 172.21.15.5:0/3717135128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840af660 con 0x7f44940cdfb0 2023-11-24T07:58:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 -- 172.21.15.5:0/3717135128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cdfb0 msgr2=0x7f44940abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cdfb0 0x7f44940abf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f44940d0040 tx=0x7f448401eba0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 -- 172.21.15.5:0/3717135128 shutdown_connections 2023-11-24T07:58:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cbd50 0x7f44940cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 --2- 172.21.15.5:0/3717135128 >> v2:172.21.15.102:3300/0 conn(0x7f449415a710 0x7f44940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 --2- 172.21.15.5:0/3717135128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cdfb0 0x7f44940abf90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 -- 172.21.15.5:0/3717135128 >> 172.21.15.5:0/3717135128 conn(0x7f44940b0cb0 msgr2=0x7f44940b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 -- 172.21.15.5:0/3717135128 shutdown_connections 2023-11-24T07:58:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.352+0000 7f4499735640 1 -- 172.21.15.5:0/3717135128 wait complete. 2023-11-24T07:58:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 Processor -- start 2023-11-24T07:58:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- start start 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cdfb0 0x7f44941556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f449415a710 0x7f4494163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415ab40 con 0x7f44940cbd50 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415ade0 con 0x7f449415a710 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4494071660 con 0x7f44940cdfb0 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58426/0 (socket says 172.21.15.5:58426) 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 -- 172.21.15.5:0/2078017303 learned_addr learned my addr 172.21.15.5:0/2078017303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f448bfff640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cdfb0 0x7f44941556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f44937fe640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f449415a710 0x7f4494163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 -- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cdfb0 msgr2=0x7f44941556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cdfb0 0x7f44941556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 -- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f449415a710 msgr2=0x7f4494163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f449415a710 0x7f4494163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 -- 172.21.15.5:0/2078017303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448400b770 con 0x7f44940cbd50 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4492ffd640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f448401c7d0 tx=0x7f448401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840afce0 con 0x7f44940cbd50 2023-11-24T07:58:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840afe40 con 0x7f44940cbd50 2023-11-24T07:58:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840b8660 con 0x7f44940cbd50 2023-11-24T07:58:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494071940 con 0x7f44940cbd50 2023-11-24T07:58:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.356+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449409cf20 con 0x7f44940cbd50 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940671f0 con 0x7f44940cbd50 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44840b6070 con 0x7f44940cbd50 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f448b7fe640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 0x7f4474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f448411ddb0 con 0x7f44940cbd50 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f448bfff640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 0x7f4474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.360+0000 7f448bfff640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 0x7f4474068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4494073930 tx=0x7f447c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.364+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4484122070 con 0x7f44940cbd50 2023-11-24T07:58:01.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:01.556+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4494071df0 con 0x7f44940cbd50 2023-11-24T07:58:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.176+0000 7f448b7fe640 1 -- 172.21.15.5:0/2078017303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44840eb1c0 con 0x7f44940cbd50 2023-11-24T07:58:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 msgr2=0x7f4474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 0x7f4474068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4494073930 tx=0x7f447c008040 comp rx=0 tx=0).stop 2023-11-24T07:58:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 msgr2=0x7f449409c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f448401c7d0 tx=0x7f448401b940 comp rx=0 tx=0).stop 2023-11-24T07:58:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 shutdown_connections 2023-11-24T07:58:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4474066470 0x7f4474068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f449415a710 0x7f4494163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44940cdfb0 0x7f44941556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 --2- 172.21.15.5:0/2078017303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44940cbd50 0x7f449409c9e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 >> 172.21.15.5:0/2078017303 conn(0x7f44940b0cb0 msgr2=0x7f44940ac120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 shutdown_connections 2023-11-24T07:58:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.180+0000 7f4499735640 1 -- 172.21.15.5:0/2078017303 wait complete. 2023-11-24T07:58:02.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T07:58:02.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 Processor -- start 2023-11-24T07:58:02.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 -- start start 2023-11-24T07:58:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feed80cb9b0 0x7feed806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feed80ce5d0 0x7feed815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed8159630 con 0x7feed80cbd90 2023-11-24T07:58:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed815bba0 con 0x7feed80cb9b0 2023-11-24T07:58:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feedd301640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed80cdd50 con 0x7feed80ce5d0 2023-11-24T07:58:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feed6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feed80cb9b0 0x7feed806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feed6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feed80cb9b0 0x7feed806e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58432/0 (socket says 172.21.15.5:58432) 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feecffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feed80cbd90 0x7feed815f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38490/0 (socket says 172.21.15.5:38490) 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feed6ffd640 1 -- 172.21.15.5:0/625092385 learned_addr learned my addr 172.21.15.5:0/625092385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.400+0000 7feed77fe640 1 --2- 172.21.15.5:0/625092385 >> v2:172.21.15.102:3300/0 conn(0x7feed80ce5d0 0x7feed815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed6ffd640 1 -- 172.21.15.5:0/625092385 >> v2:172.21.15.102:3300/0 conn(0x7feed80ce5d0 msgr2=0x7feed815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed6ffd640 1 --2- 172.21.15.5:0/625092385 >> v2:172.21.15.102:3300/0 conn(0x7feed80ce5d0 0x7feed815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed6ffd640 1 -- 172.21.15.5:0/625092385 >> v1:172.21.15.5:6789/0 conn(0x7feed80cbd90 legacy=0x7feed815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed6ffd640 1 -- 172.21.15.5:0/625092385 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80cd1d0 con 0x7feed80cb9b0 2023-11-24T07:58:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed6ffd640 1 --2- 172.21.15.5:0/625092385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed806e3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feed8070450 tx=0x7feec801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae702b9dd2c135cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed67fc640 1 -- 172.21.15.5:0/625092385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80aa610 con 0x7feed80cb9b0 2023-11-24T07:58:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed67fc640 1 -- 172.21.15.5:0/625092385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80a6040 con 0x7feed80cb9b0 2023-11-24T07:58:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feed67fc640 1 -- 172.21.15.5:0/625092385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80aa990 con 0x7feed80cb9b0 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 -- 172.21.15.5:0/625092385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 msgr2=0x7feed806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 --2- 172.21.15.5:0/625092385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed806e3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feed8070450 tx=0x7feec801c4d0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 -- 172.21.15.5:0/625092385 shutdown_connections 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 --2- 172.21.15.5:0/625092385 >> v2:172.21.15.102:3300/0 conn(0x7feed80ce5d0 0x7feed815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 --2- 172.21.15.5:0/625092385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed806e3f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.404+0000 7feedd301640 1 -- 172.21.15.5:0/625092385 >> 172.21.15.5:0/625092385 conn(0x7feed80b0cb0 msgr2=0x7feed80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- 172.21.15.5:0/625092385 shutdown_connections 2023-11-24T07:58:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- 172.21.15.5:0/625092385 wait complete. 2023-11-24T07:58:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 Processor -- start 2023-11-24T07:58:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- start start 2023-11-24T07:58:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 0x7feed814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feed80ce5d0 0x7feed80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b1e00 con 0x7feed80cb9b0 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b20a0 con 0x7feed80ce5d0 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b2380 con 0x7feed80cbd90 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58436/0 (socket says 172.21.15.5:58436) 2023-11-24T07:58:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 -- 172.21.15.5:0/1461039439 learned_addr learned my addr 172.21.15.5:0/1461039439 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed77fe640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feed80ce5d0 0x7feed80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feecffff640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 0x7feed814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 -- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 msgr2=0x7feed814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 0x7feed814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 -- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feed80ce5d0 msgr2=0x7feed80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feed80ce5d0 0x7feed80b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 -- 172.21.15.5:0/1461039439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80094d0 con 0x7feed80cb9b0 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feecffff640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 0x7feed814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feed6ffd640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feec80190e0 tx=0x7feec801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80bd5f0 con 0x7feed80cb9b0 2023-11-24T07:58:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80bd750 con 0x7feed80cb9b0 2023-11-24T07:58:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80b2660 con 0x7feed80cb9b0 2023-11-24T07:58:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.408+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80bdae0 con 0x7feed80cb9b0 2023-11-24T07:58:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed814ae70 con 0x7feed80cb9b0 2023-11-24T07:58:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed80671f0 con 0x7feed80cb9b0 2023-11-24T07:58:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feec80b33f0 con 0x7feed80cb9b0 2023-11-24T07:58:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feecf7fe640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 0x7feeb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7feec811ef40 con 0x7feed80cb9b0 2023-11-24T07:58:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feecffff640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 0x7feeb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.412+0000 7feecffff640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 0x7feeb8068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feed80ad600 tx=0x7feec0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:02.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.416+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feec80ec2c0 con 0x7feed80cb9b0 2023-11-24T07:58:02.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:02.576+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feed806b460 con 0x7feed80cb9b0 2023-11-24T07:58:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.180+0000 7feecf7fe640 1 -- 172.21.15.5:0/1461039439 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7feec80ef8e0 con 0x7feed80cb9b0 2023-11-24T07:58:03.184 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-11-24T07:58:03.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 msgr2=0x7feeb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 0x7feeb8068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feed80ad600 tx=0x7feec0009040 comp rx=0 tx=0).stop 2023-11-24T07:58:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 msgr2=0x7feed80b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feec80190e0 tx=0x7feec801ad10 comp rx=0 tx=0).stop 2023-11-24T07:58:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 shutdown_connections 2023-11-24T07:58:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb8066470 0x7feeb8068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feed80ce5d0 0x7feed80b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feed80cbd90 0x7feed814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 --2- 172.21.15.5:0/1461039439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feed80cb9b0 0x7feed80b2e60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 >> 172.21.15.5:0/1461039439 conn(0x7feed80b0cb0 msgr2=0x7feed8071760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 shutdown_connections 2023-11-24T07:58:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.184+0000 7feedd301640 1 -- 172.21.15.5:0/1461039439 wait complete. 2023-11-24T07:58:03.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T07:58:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 Processor -- start 2023-11-24T07:58:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 -- start start 2023-11-24T07:58:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 0x7f4fb40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fb4070890 0x7f4fb4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb4072950 con 0x7f4fb40ae680 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb406e2b0 con 0x7f4fb4070890 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb8ae4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb406c6f0 con 0x7f4fb4159f00 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fb4070890 0x7f4fb4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fabfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fb40ae680 0x7f4fb40cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38500/0 (socket says 172.21.15.5:38500) 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fabfff640 1 -- 172.21.15.5:0/910970756 learned_addr learned my addr 172.21.15.5:0/910970756 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb259c640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 0x7f4fb40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb2d9d640 1 -- 172.21.15.5:0/910970756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 msgr2=0x7f4fb40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb2d9d640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 0x7f4fb40ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb2d9d640 1 -- 172.21.15.5:0/910970756 >> v1:172.21.15.5:6789/0 conn(0x7f4fb40ae680 legacy=0x7f4fb40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb2d9d640 1 -- 172.21.15.5:0/910970756 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb406e550 con 0x7f4fb4070890 2023-11-24T07:58:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb259c640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 0x7f4fb40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.360+0000 7f4fb1d9b640 1 -- 172.21.15.5:0/910970756 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298146677 0 0) 0x7f4fb4072950 con 0x7f4fb40ae680 2023-11-24T07:58:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb2d9d640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4070890 0x7f4fb4070cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009d90 tx=0x7f4fac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546246512e652391 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb1d9b640 1 -- 172.21.15.5:0/910970756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0a5850 con 0x7f4fb4070890 2023-11-24T07:58:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb1d9b640 1 -- 172.21.15.5:0/910970756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac0a59b0 con 0x7f4fb4070890 2023-11-24T07:58:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb1d9b640 1 -- 172.21.15.5:0/910970756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0a5d40 con 0x7f4fb4070890 2023-11-24T07:58:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/910970756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4070890 msgr2=0x7f4fb4070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4070890 0x7f4fb4070cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009d90 tx=0x7f4fac01c920 comp rx=0 tx=0).stop 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/910970756 shutdown_connections 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4070890 0x7f4fb4070cf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/910970756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb4159f00 0x7f4fb40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/910970756 >> 172.21.15.5:0/910970756 conn(0x7f4fb40b0cb0 msgr2=0x7f4fb40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/910970756 shutdown_connections 2023-11-24T07:58:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.364+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/910970756 wait complete. 2023-11-24T07:58:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 Processor -- start 2023-11-24T07:58:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 -- start start 2023-11-24T07:58:03.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb4070890 0x7f4fb40ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb41671f0 0x7f4fb4156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb40abf90 con 0x7f4fb40ae680 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb40acad0 con 0x7f4fb4070890 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb40ac1a0 con 0x7f4fb41671f0 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58466/0 (socket says 172.21.15.5:58466) 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 -- 172.21.15.5:0/3859425621 learned_addr learned my addr 172.21.15.5:0/3859425621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb2d9d640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb41671f0 0x7f4fb4156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb259c640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb4070890 0x7f4fb40ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 -- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb41671f0 msgr2=0x7f4fb4156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb41671f0 0x7f4fb4156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 -- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb4070890 msgr2=0x7f4fb40ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb4070890 0x7f4fb40ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 -- 172.21.15.5:0/3859425621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009a70 con 0x7f4fb40ae680 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fabfff640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0011f0 tx=0x7f4f9c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0074e0 con 0x7f4fb40ae680 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c007640 con 0x7f4fb40ae680 2023-11-24T07:58:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c004a10 con 0x7f4fb40ae680 2023-11-24T07:58:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.368+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb40ac480 con 0x7f4fb40ae680 2023-11-24T07:58:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb4152070 con 0x7f4fb40ae680 2023-11-24T07:58:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb4150b80 con 0x7f4fb40ae680 2023-11-24T07:58:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f9c004b70 con 0x7f4fb40ae680 2023-11-24T07:58:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4faaffd640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 0x7f4f94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4f9c082ff0 con 0x7f4fb40ae680 2023-11-24T07:58:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.372+0000 7f4fb259c640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 0x7f4f94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.376+0000 7f4fb259c640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 0x7f4f94068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40045f0 tx=0x7f4fa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.376+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f9c0b4280 con 0x7f4fb40ae680 2023-11-24T07:58:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:03.548+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fb40671f0 con 0x7f4fb40ae680 2023-11-24T07:58:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.184+0000 7f4faaffd640 1 -- 172.21.15.5:0/3859425621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4f9c018070 con 0x7f4fb40ae680 2023-11-24T07:58:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-11-24T07:58:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 msgr2=0x7f4f94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 0x7f4f94068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40045f0 tx=0x7f4fa4008040 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 msgr2=0x7f4fb4166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0011f0 tx=0x7f4f9c00c9b0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 shutdown_connections 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4f94066470 0x7f4f94068930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fb41671f0 0x7f4fb4156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb40ae680 0x7f4fb4166cb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 --2- 172.21.15.5:0/3859425621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb4070890 0x7f4fb40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 >> 172.21.15.5:0/3859425621 conn(0x7f4fb40b0cb0 msgr2=0x7f4fb40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 shutdown_connections 2023-11-24T07:58:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.188+0000 7f4fb8ae4640 1 -- 172.21.15.5:0/3859425621 wait complete. 2023-11-24T07:58:04.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T07:58:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 Processor -- start 2023-11-24T07:58:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 -- start start 2023-11-24T07:58:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fade8140390 0x7fade80b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade8142940 con 0x7fade81409f0 2023-11-24T07:58:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade8140770 con 0x7fade8140390 2023-11-24T07:58:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7faded90e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade8142bb0 con 0x7fade80b4b90 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.360+0000 7fade6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fade8140390 0x7fade80b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fade81409f0 0x7fade8160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38506/0 (socket says 172.21.15.5:38506) 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade77fe640 1 -- 172.21.15.5:0/2362027240 learned_addr learned my addr 172.21.15.5:0/2362027240 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7faddffff640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade6ffd640 1 -- 172.21.15.5:0/2362027240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 msgr2=0x7fade806ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade6ffd640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade806ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade6ffd640 1 -- 172.21.15.5:0/2362027240 >> v1:172.21.15.5:6789/0 conn(0x7fade81409f0 legacy=0x7fade8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade6ffd640 1 -- 172.21.15.5:0/2362027240 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8142e90 con 0x7fade8140390 2023-11-24T07:58:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade67fc640 1 -- 172.21.15.5:0/2362027240 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113799994 0 0) 0x7fade8142940 con 0x7fade81409f0 2023-11-24T07:58:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade6ffd640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade8140390 0x7fade80b4650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fadd80097c0 tx=0x7fadd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5098a08d68fdd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade67fc640 1 -- 172.21.15.5:0/2362027240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80ad660 con 0x7fade8140390 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade67fc640 1 -- 172.21.15.5:0/2362027240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80ad7c0 con 0x7fade8140390 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.364+0000 7fade67fc640 1 -- 172.21.15.5:0/2362027240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80adb50 con 0x7fade8140390 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- 172.21.15.5:0/2362027240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade8140390 msgr2=0x7fade80b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade8140390 0x7fade80b4650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fadd80097c0 tx=0x7fadd801c450 comp rx=0 tx=0).stop 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- 172.21.15.5:0/2362027240 shutdown_connections 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade806ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- 172.21.15.5:0/2362027240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade8140390 0x7fade80b4650 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- 172.21.15.5:0/2362027240 >> 172.21.15.5:0/2362027240 conn(0x7fade80666a0 msgr2=0x7fade8066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- 172.21.15.5:0/2362027240 shutdown_connections 2023-11-24T07:58:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- 172.21.15.5:0/2362027240 wait complete. 2023-11-24T07:58:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 Processor -- start 2023-11-24T07:58:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- start start 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 0x7fade81416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade81579a0 con 0x7fade81409f0 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade815a5a0 con 0x7fade8140390 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faded90e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade815a880 con 0x7fade80b4b90 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58484/0 (socket says 172.21.15.5:58484) 2023-11-24T07:58:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 -- 172.21.15.5:0/3574807794 learned_addr learned my addr 172.21.15.5:0/3574807794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faddffff640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 0x7fade81416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade6ffd640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 -- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 msgr2=0x7fade8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade8155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 -- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 msgr2=0x7fade81416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 0x7fade81416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade77fe640 1 -- 172.21.15.5:0/3574807794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009420 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7fade6ffd640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.368+0000 7faddffff640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 0x7fade81416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade77fe640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fade000c6d0 tx=0x7fade000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0004d70 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000a640 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000aa70 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade815ab60 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade815b120 con 0x7fade81409f0 2023-11-24T07:58:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade8074990 con 0x7fade81409f0 2023-11-24T07:58:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fade00070d0 con 0x7fade81409f0 2023-11-24T07:58:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 0x7fadc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fade00831b0 con 0x7fade81409f0 2023-11-24T07:58:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.372+0000 7fade6ffd640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 0x7fadc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.376+0000 7fade6ffd640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 0x7fadc8068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.376+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fade00509c0 con 0x7fade81409f0 2023-11-24T07:58:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.532+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fade8070d10 con 0x7fade81409f0 2023-11-24T07:58:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.536+0000 7fade4ff9640 1 -- 172.21.15.5:0/3574807794 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fade0053fe0 con 0x7fade81409f0 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 msgr2=0x7fadc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 0x7fadc8068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7000 comp rx=0 tx=0).stop 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 msgr2=0x7fade8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fade000c6d0 tx=0x7fade000cb90 comp rx=0 tx=0).stop 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 shutdown_connections 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fadc8066470 0x7fadc8068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fade81409f0 0x7fade8159ec0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fade8140390 0x7fade81416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 --2- 172.21.15.5:0/3574807794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fade80b4b90 0x7fade8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 >> 172.21.15.5:0/3574807794 conn(0x7fade80666a0 msgr2=0x7fade8066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 shutdown_connections 2023-11-24T07:58:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.540+0000 7faded90e640 1 -- 172.21.15.5:0/3574807794 wait complete. 2023-11-24T07:58:04.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T07:58:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.700+0000 7f447b501640 1 Processor -- start 2023-11-24T07:58:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.700+0000 7f447b501640 1 -- start start 2023-11-24T07:58:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f44740b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f447415a9c0 0x7f44740715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4474071af0 0x7f447406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44740b4ca0 con 0x7f447415a9c0 2023-11-24T07:58:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4474157940 con 0x7f4474071af0 2023-11-24T07:58:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447b501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4474071f40 con 0x7f4474157560 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f447415a9c0 0x7f44740715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f447415a9c0 0x7f44740715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58490/0 (socket says 172.21.15.5:58490) 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 -- 172.21.15.5:0/4262775305 learned_addr learned my addr 172.21.15.5:0/4262775305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4479a9e640 1 --2- 172.21.15.5:0/4262775305 >> v2:172.21.15.102:3300/0 conn(0x7f4474071af0 0x7f447406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f447929d640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f44740b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 -- 172.21.15.5:0/4262775305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 msgr2=0x7f44740b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f44740b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 -- 172.21.15.5:0/4262775305 >> v2:172.21.15.102:3300/0 conn(0x7f4474071af0 msgr2=0x7f447406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 --2- 172.21.15.5:0/4262775305 >> v2:172.21.15.102:3300/0 conn(0x7f4474071af0 0x7f447406cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.704+0000 7f4478a9c640 1 -- 172.21.15.5:0/4262775305 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740b4e90 con 0x7f447415a9c0 2023-11-24T07:58:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f4478a9c640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447415a9c0 0x7f44740715b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f447406bc80 tx=0x7f446401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2213bd8ef3b55cf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f446bfff640 1 -- 172.21.15.5:0/4262775305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640ac410 con 0x7f447415a9c0 2023-11-24T07:58:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f446bfff640 1 -- 172.21.15.5:0/4262775305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640ac570 con 0x7f447415a9c0 2023-11-24T07:58:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f446bfff640 1 -- 172.21.15.5:0/4262775305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640ac900 con 0x7f447415a9c0 2023-11-24T07:58:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- 172.21.15.5:0/4262775305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447415a9c0 msgr2=0x7f44740715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447415a9c0 0x7f44740715b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f447406bc80 tx=0x7f446401c470 comp rx=0 tx=0).stop 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- 172.21.15.5:0/4262775305 shutdown_connections 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 --2- 172.21.15.5:0/4262775305 >> v2:172.21.15.102:3300/0 conn(0x7f4474071af0 0x7f447406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447415a9c0 0x7f44740715b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 --2- 172.21.15.5:0/4262775305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f44740b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- 172.21.15.5:0/4262775305 >> 172.21.15.5:0/4262775305 conn(0x7f44740b1e40 msgr2=0x7f4474070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- 172.21.15.5:0/4262775305 shutdown_connections 2023-11-24T07:58:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- 172.21.15.5:0/4262775305 wait complete. 2023-11-24T07:58:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 Processor -- start 2023-11-24T07:58:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.708+0000 7f447b501640 1 -- start start 2023-11-24T07:58:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f447414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 0x7f447414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4474143d80 con 0x7f4474071af0 2023-11-24T07:58:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4474153af0 con 0x7f447415a9c0 2023-11-24T07:58:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4474153dd0 con 0x7f4474157560 2023-11-24T07:58:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58498/0 (socket says 172.21.15.5:58498) 2023-11-24T07:58:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 -- 172.21.15.5:0/2629156508 learned_addr learned my addr 172.21.15.5:0/2629156508 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4478a9c640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f447414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4479a9e640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 0x7f447414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 -- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 msgr2=0x7f447414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f447414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 -- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 msgr2=0x7f447414c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 0x7f447414c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 -- 172.21.15.5:0/2629156508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640094d0 con 0x7f4474071af0 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4479a9e640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 0x7f447414c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447929d640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f447000e930 tx=0x7f447000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470009690 con 0x7f4474071af0 2023-11-24T07:58:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000ca00 con 0x7f4474071af0 2023-11-24T07:58:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000cd70 con 0x7f4474071af0 2023-11-24T07:58:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44741540b0 con 0x7f4474071af0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4474154670 con 0x7f4474071af0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.712+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447404e850 con 0x7f4474071af0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.716+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4470013470 con 0x7f4474071af0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.716+0000 7f4469ffb640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 0x7f4458068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.716+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4470083dc0 con 0x7f4474071af0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.716+0000 7f4478a9c640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 0x7f4458068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.716+0000 7f4478a9c640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 0x7f4458068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f44640ae000 tx=0x7f44640a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.720+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4470051610 con 0x7f4474071af0 2023-11-24T07:58:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:04.928+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f447406e960 con 0x7f4474071af0 2023-11-24T07:58:05.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.188+0000 7f4469ffb640 1 -- 172.21.15.5:0/2629156508 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v95) v1 ==== 167+0+0 (secure 0 0 0) 0x7f44700170e0 con 0x7f4474071af0 2023-11-24T07:58:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 msgr2=0x7f4458068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 0x7f4458068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f44640ae000 tx=0x7f44640a6040 comp rx=0 tx=0).stop 2023-11-24T07:58:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 msgr2=0x7f44740cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f447000e930 tx=0x7f447000edf0 comp rx=0 tx=0).stop 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 shutdown_connections 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4458066470 0x7f4458068930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f447415a9c0 0x7f447414c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4474157560 0x7f447414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 --2- 172.21.15.5:0/2629156508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4474071af0 0x7f44740cbb90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 >> 172.21.15.5:0/2629156508 conn(0x7f44740b1e40 msgr2=0x7f44740b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 shutdown_connections 2023-11-24T07:58:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:05.192+0000 7f447b501640 1 -- 172.21.15.5:0/2629156508 wait complete. 2023-11-24T07:58:05.216 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ERROR 2023-11-24T07:58:05.216 INFO:tasks.cephfs_test_runner: 2023-11-24T07:58:05.216 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 8014, in test_volumes_module_finisher_thread 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner: 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:Ran 1 test in 47.742s 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner: 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T07:58:05.217 INFO:tasks.cephfs_test_runner: 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 8014, in test_volumes_module_finisher_thread 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T07:58:05.218 INFO:tasks.cephfs_test_runner: 2023-11-24T07:58:05.218 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T07:58:07.029 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=53c6726510b444238ae44e92ebec6d2a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T07:58:07.031 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T07:58:07.041 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-11-24T07:58:07.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:58:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.232+0000 7f0ccba9a640 1 Processor -- start 2023-11-24T07:58:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.232+0000 7f0ccba9a640 1 -- start start 2023-11-24T07:58:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0ccba9a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0cc406dc90 0x7f0cc40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0ccba9a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40b25b0 con 0x7f0cc406e070 2023-11-24T07:58:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0ccba9a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40b2890 con 0x7f0cc40b2040 2023-11-24T07:58:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0ccba9a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc4161ef0 con 0x7f0cc406dc90 2023-11-24T07:58:07.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9035640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0cc406e070 0x7f0cc40ad950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59674/0 (socket says 172.21.15.5:59674) 2023-11-24T07:58:07.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9035640 1 -- 172.21.15.5:0/4185071778 learned_addr learned my addr 172.21.15.5:0/4185071778 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:07.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9836640 1 --2- 172.21.15.5:0/4185071778 >> v2:172.21.15.102:3300/0 conn(0x7f0cc406dc90 0x7f0cc40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432423198 0 0) 0x7f0cc40b25b0 con 0x7f0cc406e070 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb0003530 con 0x7f0cc406e070 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9836640 1 -- 172.21.15.5:0/4185071778 >> v1:172.21.15.102:6789/0 conn(0x7f0cc40b2040 legacy=0x7f0cc4165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545940698 0 0) 0x7f0cc40b2890 con 0x7f0cc40b2040 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9836640 1 -- 172.21.15.5:0/4185071778 >> v1:172.21.15.5:6789/0 conn(0x7f0cc406e070 legacy=0x7f0cc40ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.236+0000 7f0cc9836640 1 -- 172.21.15.5:0/4185071778 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40b2b70 con 0x7f0cc406dc90 2023-11-24T07:58:07.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0cc9836640 1 --2- 172.21.15.5:0/4185071778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc40b3650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097c0 tx=0x7f0cc001eab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93185f88fdf11b07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4001600 con 0x7f0cc406dc90 2023-11-24T07:58:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00a8570 con 0x7f0cc406dc90 2023-11-24T07:58:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0cc8834640 1 -- 172.21.15.5:0/4185071778 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00a8900 con 0x7f0cc406dc90 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 -- 172.21.15.5:0/4185071778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 msgr2=0x7f0cc40b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/4185071778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc40b3650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097c0 tx=0x7f0cc001eab0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 -- 172.21.15.5:0/4185071778 shutdown_connections 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/4185071778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc40b3650 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 -- 172.21.15.5:0/4185071778 >> 172.21.15.5:0/4185071778 conn(0x7f0cc406a5b0 msgr2=0x7f0cc406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 -- 172.21.15.5:0/4185071778 shutdown_connections 2023-11-24T07:58:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.240+0000 7f0ccba9a640 1 -- 172.21.15.5:0/4185071778 wait complete. 2023-11-24T07:58:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 Processor -- start 2023-11-24T07:58:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- start start 2023-11-24T07:58:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b2040 0x7f0cc4145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415c8f0 con 0x7f0cc406e070 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415cb80 con 0x7f0cc406dc90 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415ce60 con 0x7f0cc40b2040 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55868/0 (socket says 172.21.15.5:55868) 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 -- 172.21.15.5:0/2438135725 learned_addr learned my addr 172.21.15.5:0/2438135725 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9836640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cca037640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b2040 0x7f0cc4145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 -- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b2040 msgr2=0x7f0cc4145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b2040 0x7f0cc4145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 -- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 msgr2=0x7f0cc415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 -- 172.21.15.5:0/2438135725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009420 con 0x7f0cc406e070 2023-11-24T07:58:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cc9035640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c730 tx=0x7f0cb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40074e0 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4007660 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc415d140 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4004a30 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.244+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc415d700 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404e850 con 0x7f0cc406e070 2023-11-24T07:58:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cb4004c50 con 0x7f0cc406e070 2023-11-24T07:58:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0cba7fc640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0cb40831a0 con 0x7f0cc406e070 2023-11-24T07:58:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0cc9836640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.248+0000 7f0cc9836640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 0x7f0ca8068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b2000 tx=0x7f0cc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.252+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cb40508b0 con 0x7f0cc406e070 2023-11-24T07:58:07.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.408+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc4160d80 con 0x7f0cc406e070 2023-11-24T07:58:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0cba7fc640 1 -- 172.21.15.5:0/2438135725 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f0cb4053ed0 con 0x7f0cc406e070 2023-11-24T07:58:07.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:07.415 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:58:04.183911+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1586527042":"2023-11-25T07:58:01.171458+0000","172.21.15.5:6834/1586527042":"2023-11-25T07:58:01.171458+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:58:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 msgr2=0x7f0ca8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 0x7f0ca8068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b2000 tx=0x7f0cc0008040 comp rx=0 tx=0).stop 2023-11-24T07:58:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 msgr2=0x7f0cc41fab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c730 tx=0x7f0cb400cbf0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 shutdown_connections 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b2040 0x7f0cc4145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406e070 0x7f0cc41fab50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 --2- 172.21.15.5:0/2438135725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc406dc90 0x7f0cc415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 >> 172.21.15.5:0/2438135725 conn(0x7f0cc406a5b0 msgr2=0x7f0cc40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 shutdown_connections 2023-11-24T07:58:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.412+0000 7f0ccba9a640 1 -- 172.21.15.5:0/2438135725 wait complete. 2023-11-24T07:58:07.435 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T07:56:37.301032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T07:58:07.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T07:58:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 Processor -- start 2023-11-24T07:58:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 -- start start 2023-11-24T07:58:07.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc64406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6440ce5d0 0x7fc64415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc644159630 con 0x7fc6440cbd90 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64415bba0 con 0x7fc6440ce5d0 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc648da1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440cdd50 con 0x7fc6440cb9b0 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6440ce5d0 0x7fc64415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6440ce5d0 0x7fc64415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55876/0 (socket says 172.21.15.5:55876) 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 -- 172.21.15.5:0/1433403270 learned_addr learned my addr 172.21.15.5:0/1433403270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc641d9b640 1 --1- 172.21.15.5:0/1433403270 >> v1:172.21.15.5:6789/0 conn(0x7fc6440cbd90 0x7fc64415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59688/0 (socket says 172.21.15.5:59688) 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc64259c640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc64406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 -- 172.21.15.5:0/1433403270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 msgr2=0x7fc64406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc64406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 -- 172.21.15.5:0/1433403270 >> v1:172.21.15.5:6789/0 conn(0x7fc6440cbd90 legacy=0x7fc64415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc642d9d640 1 -- 172.21.15.5:0/1433403270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6440cd1d0 con 0x7fc6440ce5d0 2023-11-24T07:58:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.580+0000 7fc64159a640 1 -- 172.21.15.5:0/1433403270 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956118166 0 0) 0x7fc644159630 con 0x7fc6440cbd90 2023-11-24T07:58:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc642d9d640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440ce5d0 0x7fc64415bfd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009e50 tx=0x7fc63c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd209d679bfd2b60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc64159a640 1 -- 172.21.15.5:0/1433403270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0a5880 con 0x7fc6440ce5d0 2023-11-24T07:58:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc64159a640 1 -- 172.21.15.5:0/1433403270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0a59e0 con 0x7fc6440ce5d0 2023-11-24T07:58:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc64159a640 1 -- 172.21.15.5:0/1433403270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0a5d70 con 0x7fc6440ce5d0 2023-11-24T07:58:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 -- 172.21.15.5:0/1433403270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440ce5d0 msgr2=0x7fc64415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440ce5d0 0x7fc64415bfd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009e50 tx=0x7fc63c01c9e0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 -- 172.21.15.5:0/1433403270 shutdown_connections 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440ce5d0 0x7fc64415bfd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 --2- 172.21.15.5:0/1433403270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc64406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 -- 172.21.15.5:0/1433403270 >> 172.21.15.5:0/1433403270 conn(0x7fc6440b0cb0 msgr2=0x7fc6440b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 -- 172.21.15.5:0/1433403270 shutdown_connections 2023-11-24T07:58:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.584+0000 7fc648da1640 1 -- 172.21.15.5:0/1433403270 wait complete. 2023-11-24T07:58:07.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 Processor -- start 2023-11-24T07:58:07.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- start start 2023-11-24T07:58:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc644154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 0x7fc644152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441553a0 con 0x7fc6440cbd90 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc644155680 con 0x7fc6440ce5d0 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc644155960 con 0x7fc6440cb9b0 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55882/0 (socket says 172.21.15.5:55882) 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 -- 172.21.15.5:0/231307582 learned_addr learned my addr 172.21.15.5:0/231307582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc64259c640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc644154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc642d9d640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 0x7fc644152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 -- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 msgr2=0x7fc644154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc644154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 -- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 msgr2=0x7fc644152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 0x7fc644152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 -- 172.21.15.5:0/231307582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009b30 con 0x7fc6440cbd90 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc642d9d640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 0x7fc644152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc641d9b640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6380011f0 tx=0x7fc63800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6380074e0 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638007640 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc644155c40 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638004a10 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc644155160 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.588+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6440671f0 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.592+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc638004b70 con 0x7fc6440cbd90 2023-11-24T07:58:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.592+0000 7fc632ffd640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 0x7fc624068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.592+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc638082f40 con 0x7fc6440cbd90 2023-11-24T07:58:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.592+0000 7fc64259c640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 0x7fc624068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.592+0000 7fc64259c640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 0x7fc624068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc634009b60 tx=0x7fc634009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.596+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6380506d0 con 0x7fc6440cbd90 2023-11-24T07:58:07.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.756+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc644155160 con 0x7fc6440cbd90 2023-11-24T07:58:07.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.756+0000 7fc632ffd640 1 -- 172.21.15.5:0/231307582 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc644155160 con 0x7fc6440cbd90 2023-11-24T07:58:07.762 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 msgr2=0x7fc624068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 0x7fc624068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc634009b60 tx=0x7fc634009190 comp rx=0 tx=0).stop 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 msgr2=0x7fc6441575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6380011f0 tx=0x7fc63800c9b0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 shutdown_connections 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fc624066470 0x7fc624068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6440ce5d0 0x7fc644152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6440cbd90 0x7fc6441575e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 --2- 172.21.15.5:0/231307582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6440cb9b0 0x7fc644154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 >> 172.21.15.5:0/231307582 conn(0x7fc6440b0cb0 msgr2=0x7fc644071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 shutdown_connections 2023-11-24T07:58:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.760+0000 7fc648da1640 1 -- 172.21.15.5:0/231307582 wait complete. 2023-11-24T07:58:07.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-11-24T07:58:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.920+0000 7f9bd485a640 1 Processor -- start 2023-11-24T07:58:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.920+0000 7f9bd485a640 1 -- start start 2023-11-24T07:58:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bd0143ae0 0x7f9bd00b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 0x7f9bd00ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00b2480 con 0x7f9bd0143ae0 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd006e950 con 0x7f9bd00adcc0 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bd485a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0070670 con 0x7f9bd006dfd0 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bd0143ae0 0x7f9bd00b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bd0143ae0 0x7f9bd00b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55888/0 (socket says 172.21.15.5:55888) 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 -- 172.21.15.5:0/4260094735 learned_addr learned my addr 172.21.15.5:0/4260094735 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bc7fff640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bced9d640 1 --2- 172.21.15.5:0/4260094735 >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 0x7f9bd00ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 -- 172.21.15.5:0/4260094735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 msgr2=0x7f9bd006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 -- 172.21.15.5:0/4260094735 >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 msgr2=0x7f9bd00ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 --2- 172.21.15.5:0/4260094735 >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 0x7f9bd00ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bce59c640 1 -- 172.21.15.5:0/4260094735 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0070950 con 0x7f9bd0143ae0 2023-11-24T07:58:07.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.924+0000 7f9bced9d640 1 --2- 172.21.15.5:0/4260094735 >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 0x7f9bd00ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bce59c640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd0143ae0 0x7f9bd00b1f40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9bd006c950 tx=0x7f9bc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88640eb5207536c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bcdd9b640 1 -- 172.21.15.5:0/4260094735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00aa5f0 con 0x7f9bd0143ae0 2023-11-24T07:58:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bcdd9b640 1 -- 172.21.15.5:0/4260094735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc00aa750 con 0x7f9bd0143ae0 2023-11-24T07:58:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bcdd9b640 1 -- 172.21.15.5:0/4260094735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00aaae0 con 0x7f9bd0143ae0 2023-11-24T07:58:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- 172.21.15.5:0/4260094735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd0143ae0 msgr2=0x7f9bd00b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd0143ae0 0x7f9bd00b1f40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9bd006c950 tx=0x7f9bc001c4d0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- 172.21.15.5:0/4260094735 shutdown_connections 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 --2- 172.21.15.5:0/4260094735 >> v2:172.21.15.102:3300/0 conn(0x7f9bd00adcc0 0x7f9bd00ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 --2- 172.21.15.5:0/4260094735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd0143ae0 0x7f9bd00b1f40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- 172.21.15.5:0/4260094735 >> 172.21.15.5:0/4260094735 conn(0x7f9bd00b0c40 msgr2=0x7f9bd00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- 172.21.15.5:0/4260094735 shutdown_connections 2023-11-24T07:58:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- 172.21.15.5:0/4260094735 wait complete. 2023-11-24T07:58:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 Processor -- start 2023-11-24T07:58:07.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 -- start start 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.928+0000 7f9bd485a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd01599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bd0143ae0 0x7f9bd0141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0131650 con 0x7f9bd00adcc0 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0131090 con 0x7f9bd0143ae0 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0131370 con 0x7f9bd006dfd0 2023-11-24T07:58:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55890/0 (socket says 172.21.15.5:55890) 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 -- 172.21.15.5:0/520904768 learned_addr learned my addr 172.21.15.5:0/520904768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bce59c640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd01599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bced9d640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bd0143ae0 0x7f9bd0141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 -- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 msgr2=0x7f9bd01599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd01599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 -- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bd0143ae0 msgr2=0x7f9bd0141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bd0143ae0 0x7f9bd0141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 -- 172.21.15.5:0/520904768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00094d0 con 0x7f9bd00adcc0 2023-11-24T07:58:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc7fff640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800e870 tx=0x7f9bb800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8009510 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800eec0 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800cb40 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd012e7c0 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd0159f10 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd012e620 con 0x7f9bd00adcc0 2023-11-24T07:58:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.932+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bb800cca0 con 0x7f9bd00adcc0 2023-11-24T07:58:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.936+0000 7f9bc6ffd640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 0x7f9bb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.936+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bb8083c00 con 0x7f9bd00adcc0 2023-11-24T07:58:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.936+0000 7f9bce59c640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 0x7f9bb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.936+0000 7f9bce59c640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 0x7f9bb0068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ae000 tx=0x7f9bc00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:07.940+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bd012e620 con 0x7f9bd00adcc0 2023-11-24T07:58:08.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.132+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f9bd012e620 con 0x7f9bd00adcc0 2023-11-24T07:58:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.140+0000 7f9bc6ffd640 1 -- 172.21.15.5:0/520904768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) v1 ==== 81+0+446534 (secure 0 0 0) 0x7f9bd012e620 con 0x7f9bd00adcc0 2023-11-24T07:58:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 5, 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 4103, 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2023-11-24T07:58:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:6832", 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2673346826 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-11-24T07:58:08.149 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:6833", 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2673346826 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.102:6833/2673346826", 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2023-11-24T07:56:29.225198+0000", 2023-11-24T07:58:08.150 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540138322906710015, 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 4101, 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540138322906710015, 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-11-24T07:58:08.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.155 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.156 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.160 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-11-24T07:58:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-11-24T07:58:08.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T07:58:08.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-11-24T07:58:08.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-11-24T07:58:08.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.194 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.198 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-11-24T07:58:08.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-11-24T07:58:08.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.210 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.213 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.214 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-11-24T07:58:08.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-11-24T07:58:08.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-11-24T07:58:08.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-11-24T07:58:08.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T07:58:08.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T07:58:08.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T07:58:08.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.235 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-11-24T07:58:08.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.239 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.246 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-11-24T07:58:08.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-11-24T07:58:08.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T07:58:08.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.259 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-11-24T07:58:08.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-11-24T07:58:08.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-11-24T07:58:08.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T07:58:08.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-11-24T07:58:08.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.281 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.286 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-11-24T07:58:08.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-11-24T07:58:08.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-11-24T07:58:08.302 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-11-24T07:58:08.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-11-24T07:58:08.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T07:58:08.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.316 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-11-24T07:58:08.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.324 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.325 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.329 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.331 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.337 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T07:58:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T07:58:08.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.346 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T07:58:08.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.357 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.359 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.359 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.365 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T07:58:08.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T07:58:08.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-11-24T07:58:08.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.372 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:08.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T07:58:08.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T07:58:08.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T07:58:08.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T07:58:08.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.388 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.393 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.396 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.397 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T07:58:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.403 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.407 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T07:58:08.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.416 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T07:58:08.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T07:58:08.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.425 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-11-24T07:58:08.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-11-24T07:58:08.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.432 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.434 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.438 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-11-24T07:58:08.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-11-24T07:58:08.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.453 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.458 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.461 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.466 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.468 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-11-24T07:58:08.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.478 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.483 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.488 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.489 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-11-24T07:58:08.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-11-24T07:58:08.498 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-11-24T07:58:08.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-11-24T07:58:08.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.507 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.511 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.516 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-11-24T07:58:08.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T07:58:08.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.523 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.527 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.537 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.541 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.545 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.548 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.550 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.552 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.553 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.554 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-11-24T07:58:08.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.558 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.561 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-11-24T07:58:08.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.567 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.571 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.575 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.577 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.581 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-11-24T07:58:08.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.586 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.589 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.590 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-11-24T07:58:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-11-24T07:58:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.610 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.620 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.621 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-11-24T07:58:08.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T07:58:08.632 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.633 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.634 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.635 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.636 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.638 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.640 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.641 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.642 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.644 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-11-24T07:58:08.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-11-24T07:58:08.647 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.650 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.651 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.652 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.657 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.658 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.659 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-11-24T07:58:08.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.661 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.664 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:08.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.666 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:08.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T07:58:08.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.669 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-11-24T07:58:08.671 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.675 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.677 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.681 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-11-24T07:58:08.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.686 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-11-24T07:58:08.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.691 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.692 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.695 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.696 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.699 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.701 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.704 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.705 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-11-24T07:58:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-11-24T07:58:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-11-24T07:58:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-11-24T07:58:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-11-24T07:58:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-11-24T07:58:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.790 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-11-24T07:58:08.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T07:58:08.792 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.794 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.795 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-11-24T07:58:08.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.799 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.800 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.801 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.804 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-11-24T07:58:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T07:58:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-11-24T07:58:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.862 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.863 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.867 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-11-24T07:58:08.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.872 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "restful" 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-11-24T07:58:08.873 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.877 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.880 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.881 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.884 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-11-24T07:58:08.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-11-24T07:58:08.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-11-24T07:58:08.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T07:58:08.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-11-24T07:58:08.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.904 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-11-24T07:58:08.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-11-24T07:58:08.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T07:58:08.909 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-11-24T07:58:08.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.919 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.920 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.921 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-11-24T07:58:08.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T07:58:08.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-11-24T07:58:08.925 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-11-24T07:58:08.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T07:58:08.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-11-24T07:58:08.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.936 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.939 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-11-24T07:58:08.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T07:58:08.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.945 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T07:58:08.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.950 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-11-24T07:58:08.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T07:58:08.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-11-24T07:58:08.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-11-24T07:58:08.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.972 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-11-24T07:58:08.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:08.979 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.980 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T07:58:08.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T07:58:08.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-11-24T07:58:08.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.987 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-11-24T07:58:08.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-11-24T07:58:08.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.992 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.993 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.994 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:08.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:08.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:08.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.002 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-11-24T07:58:09.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.011 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-11-24T07:58:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-11-24T07:58:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-11-24T07:58:09.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-11-24T07:58:09.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.031 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-11-24T07:58:09.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T07:58:09.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.041 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.042 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.046 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.049 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T07:58:09.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.057 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-11-24T07:58:09.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.061 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T07:58:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T07:58:09.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T07:58:09.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:09.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.084 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T07:58:09.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.091 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T07:58:09.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.098 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T07:58:09.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.105 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.109 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T07:58:09.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T07:58:09.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-11-24T07:58:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T07:58:09.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T07:58:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T07:58:09.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.130 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-11-24T07:58:09.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-11-24T07:58:09.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.145 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:09.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-11-24T07:58:09.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.160 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-11-24T07:58:09.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.164 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.170 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-11-24T07:58:09.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-11-24T07:58:09.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.190 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.196 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.197 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-11-24T07:58:09.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-11-24T07:58:09.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-11-24T07:58:09.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-11-24T07:58:09.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.218 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-11-24T07:58:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.231 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.232 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.238 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.243 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-11-24T07:58:09.251 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-11-24T07:58:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.253 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.259 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T07:58:09.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.267 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-11-24T07:58:09.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T07:58:09.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-11-24T07:58:09.271 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.273 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.274 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.277 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.282 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.287 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.298 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-11-24T07:58:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.312 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.316 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.321 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-11-24T07:58:09.324 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.326 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.327 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.328 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.335 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.340 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.341 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.343 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.346 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.349 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.353 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.354 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-11-24T07:58:09.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T07:58:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.359 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.363 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T07:58:09.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:09.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.372 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.374 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-11-24T07:58:09.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-11-24T07:58:09.378 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-11-24T07:58:09.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-11-24T07:58:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.383 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.384 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.387 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-11-24T07:58:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.414 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.419 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.427 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-11-24T07:58:09.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-11-24T07:58:09.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-11-24T07:58:09.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.447 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.453 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.454 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.457 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.458 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.462 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.463 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.466 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.467 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.468 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.472 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.473 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-11-24T07:58:09.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.477 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.481 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.485 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-11-24T07:58:09.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-11-24T07:58:09.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.498 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.499 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.500 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-11-24T07:58:09.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:09.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.506 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.510 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.513 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.515 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.517 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.517 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.519 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.523 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-11-24T07:58:09.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.528 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.529 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.530 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.534 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.539 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.543 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.544 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.550 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-11-24T07:58:09.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.556 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-11-24T07:58:09.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.558 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.563 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-11-24T07:58:09.564 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.565 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-11-24T07:58:09.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-11-24T07:58:09.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-11-24T07:58:09.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-11-24T07:58:09.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: "services": {}, 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2023-11-24T07:58:09.573 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-11-24T07:58:09.574 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-11-24T07:58:09.575 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2023-11-24T07:58:09.576 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-11-24T07:58:09.577 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-11-24T07:58:09.578 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 0, 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-11-24T07:58:09.580 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:0", 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2441556026 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-11-24T07:58:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:0", 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 827193269 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:0", 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3363854956 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.102:0", 2023-11-24T07:58:09.584 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 467814728 2023-11-24T07:58:09.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-11-24T07:58:09.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-11-24T07:58:09.585 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 msgr2=0x7f9bb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 0x7f9bb0068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ae000 tx=0x7f9bc00b5040 comp rx=0 tx=0).stop 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 msgr2=0x7f9bd01306b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800e870 tx=0x7f9bb800ec70 comp rx=0 tx=0).stop 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 shutdown_connections 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9bb0066470 0x7f9bb0068930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bd0143ae0 0x7f9bd0141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bd00adcc0 0x7f9bd01306b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 --2- 172.21.15.5:0/520904768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bd006dfd0 0x7f9bd01599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 >> 172.21.15.5:0/520904768 conn(0x7f9bd00b0c40 msgr2=0x7f9bd00b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 shutdown_connections 2023-11-24T07:58:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:08.144+0000 7f9bd485a640 1 -- 172.21.15.5:0/520904768 wait complete. 2023-11-24T07:58:09.592 DEBUG:tasks.check_counter:Getting stats from x 2023-11-24T07:58:09.592 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2023-11-24T07:58:09.733 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-24T07:58:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2023-11-24T07:58:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 206, 2023-11-24T07:58:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 75, 2023-11-24T07:58:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 2601328, 2023-11-24T07:58:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 135952, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 58, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 14, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.078999781, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.003504397, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.059863942, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-24T07:58:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 55, 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009617321, 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000174860 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2601328, 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 135952 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 560, 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 328, 2023-11-24T07:58:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3123408, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2668192, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 103, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 16, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.130778837, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.029737566, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.121162243, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000021271, 2023-11-24T07:58:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 314, 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.033790196, 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000107612 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3123408, 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 2668192 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 352, 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 210, 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1919138, 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2693920, 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 140, 2023-11-24T07:58:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 17, 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.147818752, 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.009409984, 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.139799747, 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.002904649, 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T07:58:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 199, 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.060262128, 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000302824 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1918256, 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 2693280 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2023-11-24T07:58:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client": { 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": { 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "lat": { 2023-11-24T07:58:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "wrlat": { 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "rdlat": { 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "fsync": { 2023-11-24T07:58:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "mdavg": 0.000000000, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsqsum": 0, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "mdops": 0, 2023-11-24T07:58:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "readavg": 0.000000000, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "readsqsum": 0, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "rdops": 0, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "writeavg": 0.000000000, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "writesqsum": 0, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "rdops": 0 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-Mgr": { 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.041951817, 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.020975908 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MgrStandby": { 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-balancer": { 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-cmd_finisher": { 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 17, 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000900744, 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000052984 2023-11-24T07:58:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-crash": { 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.754 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-devicehealth": { 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.755 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-iostat": { 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-nfs": { 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-orchestrator": { 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.758 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-pg_autoscaler": { 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.759 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-progress": { 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.760 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-rbd_support": { 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-restful": { 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16, 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.004106032, 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000256627 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-status": { 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-telemetry": { 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-volumes": { 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2023-11-24T07:58:09.765 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000601590, 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000601590 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: "libcephsqlite_striper": { 2023-11-24T07:58:09.766 INFO:teuthology.orchestra.run.smithi102.stdout: "update_metadata": 8, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "update_allocated": 2, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "update_size": 6, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "update_version": 8, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "shrink": 0, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "shrink_bytes": 0, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "lock": 11, 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: "unlock": 11 2023-11-24T07:58:09.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "libcephsqlite_vfs": { 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "op_open": { 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.059999504, 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.029999752 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "op_delete": { 2023-11-24T07:58:09.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "op_access": { 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "op_fullpathname": { 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "op_currenttime": { 2023-11-24T07:58:09.770 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_close": { 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.771 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_read": { 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 20, 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.007999934, 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000399996 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.772 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_write": { 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 85, 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.015999868, 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000188233 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_truncate": { 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.773 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_sync": { 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 24, 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.111999077, 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004666628 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_filesize": { 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 20, 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_lock": { 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 27, 2023-11-24T07:58:09.775 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.027999766, 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001037028 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_unlock": { 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 19, 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.007999934, 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000421049 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.776 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_checkreservedlock": { 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9, 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_filecontrol": { 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 26, 2023-11-24T07:58:09.777 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_sectorsize": { 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "opf_devicecharacteristics": { 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 30, 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2023-11-24T07:58:09.779 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-24T07:58:09.780 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2023-11-24T07:58:09.781 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-24T07:58:09.782 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2023-11-24T07:58:09.783 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2023-11-24T07:58:09.784 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 1616189, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 280, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 1496, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 17, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2023-11-24T07:58:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 32424, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 579, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2023-11-24T07:58:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 12880, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 308, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 0, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 0, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2023-11-24T07:58:09.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": { 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_hit": 0, 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_miss": 0 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "objectcacher-libcephfs": { 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_ops_hit": 0, 2023-11-24T07:58:09.788 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_ops_miss": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_bytes_hit": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_bytes_miss": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "data_read": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "data_written": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "data_flushed": 0, 2023-11-24T07:58:09.789 INFO:teuthology.orchestra.run.smithi102.stdout: "data_overwritten_while_flushing": 0, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "write_ops_blocked": 0, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "write_bytes_blocked": 0, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "write_time_blocked": 0.000000000 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2023-11-24T07:58:09.790 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 0, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 0, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 0, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 0, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.791 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 0, 2023-11-24T07:58:09.792 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2023-11-24T07:58:09.793 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2023-11-24T07:58:09.794 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2023-11-24T07:58:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2023-11-24T07:58:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2023-11-24T07:58:09.797 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2023-11-24T07:58:09.798 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 8, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 37, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 36, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 8, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 8, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2023-11-24T07:58:09.799 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2023-11-24T07:58:09.800 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2023-11-24T07:58:09.800 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2023-11-24T07:58:09.800 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2023-11-24T07:58:09.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.800 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter-0x55b4ee515040": { 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 163, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 2434716, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 0, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 163, 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2023-11-24T07:58:09.801 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 163, 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.599995041, 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003680951 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 163, 2023-11-24T07:58:09.802 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 307 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 163, 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 46, 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 117, 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2023-11-24T07:58:09.803 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 2, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 20, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 85, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2023-11-24T07:58:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2023-11-24T07:58:09.805 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 104, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 52, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 22, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2023-11-24T07:58:09.806 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 22, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2023-11-24T07:58:09.807 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2023-11-24T07:58:09.808 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2023-11-24T07:58:09.809 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2023-11-24T07:58:09.810 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2023-11-24T07:58:09.810 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2023-11-24T07:58:09.810 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 16, 2023-11-24T07:58:09.810 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 6, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 1, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 1, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2023-11-24T07:58:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter-0x55b4ee515180": { 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2023-11-24T07:58:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 0, 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 0, 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 0, 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 0, 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2023-11-24T07:58:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0 2023-11-24T07:58:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2023-11-24T07:58:09.815 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2023-11-24T07:58:09.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2023-11-24T07:58:09.817 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2023-11-24T07:58:09.818 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2023-11-24T07:58:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2023-11-24T07:58:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 0, 2023-11-24T07:58:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2023-11-24T07:58:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter-0x55b4ee5155e0": { 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2023-11-24T07:58:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 0, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 0, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 0, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 0, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 0, 2023-11-24T07:58:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2023-11-24T07:58:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2023-11-24T07:58:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2023-11-24T07:58:09.828 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2023-11-24T07:58:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2023-11-24T07:58:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2023-11-24T07:58:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2023-11-24T07:58:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter-0x55b4ee62e320": { 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2023-11-24T07:58:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 1, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 39, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 0, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 1, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2023-11-24T07:58:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003999966, 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003999966 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 1, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 1, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2023-11-24T07:58:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2023-11-24T07:58:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2023-11-24T07:58:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2023-11-24T07:58:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 1, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2023-11-24T07:58:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2023-11-24T07:58:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2023-11-24T07:58:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2023-11-24T07:58:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 0, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 1, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 1, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2023-11-24T07:58:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_client_bytes": { 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 134217728, 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 50, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 240919, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 50, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 50, 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 240919, 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_client_messages": { 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 512, 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 50, 2023-11-24T07:58:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 50, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 50, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 50, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 50, 2023-11-24T07:58:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_mds_bytes": { 2023-11-24T07:58:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 134217728, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 82, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 808246, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 82, 2023-11-24T07:58:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 82, 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 808246, 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_mds_messsages": { 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 128, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 82, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 82, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 82, 2023-11-24T07:58:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 82, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 82, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_mon_bytes": { 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 134217728, 2023-11-24T07:58:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 63, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 453920, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 63, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 63, 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 453920, 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_mon_messsages": { 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 128, 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 63, 2023-11-24T07:58:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 63, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 63, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 63, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 63, 2023-11-24T07:58:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_osd_bytes": { 2023-11-24T07:58:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 536870912, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 344, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 4169577, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 344, 2023-11-24T07:58:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 344, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 4169577, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-mgr_osd_messsages": { 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 8192, 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 344, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 344, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 344, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 344, 2023-11-24T07:58:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 344, 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 354, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 686213, 2023-11-24T07:58:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 354, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 354, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 686213, 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55b4ee514000": { 2023-11-24T07:58:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 539, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5672662, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 539, 2023-11-24T07:58:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 539, 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5672662, 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 175, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 345728, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 175, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 175, 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 345728, 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b4ee5150e0": { 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 9, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 302901, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 9, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 9, 2023-11-24T07:58:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 302901, 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b4ee5157c0": { 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 10, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 302925, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 10, 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 10, 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 302925, 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b4ee62e1e0": { 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 8, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 177722, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 8, 2023-11-24T07:58:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 8, 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 177722, 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes-0x55b4ee5145a0": { 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes-0x55b4ee514f00": { 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 163, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 2433027, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 163, 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 163, 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2433027, 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes-0x55b4ee515720": { 2023-11-24T07:58:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes-0x55b4ee62e280": { 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2023-11-24T07:58:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 1, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 1, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1, 2023-11-24T07:58:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops-0x55b4ee514500": { 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops-0x55b4ee514fa0": { 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 163, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 163, 2023-11-24T07:58:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 163, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 163, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 163, 2023-11-24T07:58:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops-0x55b4ee515680": { 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops-0x55b4ee62e000": { 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2023-11-24T07:58:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 1, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 1, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 1, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2023-11-24T07:58:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1, 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1, 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2023-11-24T07:58:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-24T07:58:09.911 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-24T07:58:09.912 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=1 2023-11-24T07:58:09.913 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2023-11-24T07:58:09.913 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T07:58:09.917 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T07:58:09.927 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T07:58:09.928 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:58:09.928 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:09.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T07:58:09.940 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:58:09.940 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:09.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T07:58:09.995 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:58:09.995 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:10.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T07:58:10.005 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:58:10.006 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:10.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T07:58:10.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.059 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:58:10.069 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T07:58:10.069 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T07:58:10.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T07:58:10.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T07:58:10.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:58:10.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.437 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:58:10.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:58:10.516 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:10.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:10.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.519 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:58:10.529 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T07:58:10.530 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T07:58:10.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T07:58:10.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T07:58:10.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.691 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:58:10.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.886 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:58:10.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:10.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:58:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:10.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:10.968 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T07:58:10.968 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:58:10.968 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:10.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 2023-11-24T07:58:10.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-24T07:58:10.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:11.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357772k,nr_inodes=4089443,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 2023-11-24T07:58:11.031 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:58:11.031 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:11.040 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 2023-11-24T07:58:11.040 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-24T07:58:11.040 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T07:58:11.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 2023-11-24T07:58:11.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.095 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:58:11.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:58:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:11.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:11.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.178 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-11-24T07:58:11.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-11-24T07:58:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:11.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:11.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.302 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:58:11.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.312 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:58:11.384 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:11.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:11.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.386 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-24T07:58:11.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T07:58:11.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-24T07:58:11.501 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-24T07:58:11.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:11.503 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T07:58:11.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T07:58:11.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:58:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 Processor -- start 2023-11-24T07:58:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 -- start start 2023-11-24T07:58:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1da4143ae0 0x7f1da40b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1da406dfd0 0x7f1da406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da406e980 con 0x7f1da40adcc0 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40ae7f0 con 0x7f1da406dfd0 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1daa616640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40b2480 con 0x7f1da4143ae0 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1da406dfd0 0x7f1da406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da8bb3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1da40adcc0 0x7f1da40ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59694/0 (socket says 172.21.15.5:59694) 2023-11-24T07:58:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da8bb3640 1 -- 172.21.15.5:0/57595586 learned_addr learned my addr 172.21.15.5:0/57595586 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da3fff640 1 --2- 172.21.15.5:0/57595586 >> v2:172.21.15.102:3300/0 conn(0x7f1da4143ae0 0x7f1da40b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da37fe640 1 -- 172.21.15.5:0/57595586 >> v2:172.21.15.102:3300/0 conn(0x7f1da4143ae0 msgr2=0x7f1da40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da37fe640 1 --2- 172.21.15.5:0/57595586 >> v2:172.21.15.102:3300/0 conn(0x7f1da4143ae0 0x7f1da40b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da37fe640 1 -- 172.21.15.5:0/57595586 >> v1:172.21.15.5:6789/0 conn(0x7f1da40adcc0 legacy=0x7f1da40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da37fe640 1 -- 172.21.15.5:0/57595586 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4070670 con 0x7f1da406dfd0 2023-11-24T07:58:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.668+0000 7f1da2ffd640 1 -- 172.21.15.5:0/57595586 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318824098 0 0) 0x7f1da406e980 con 0x7f1da40adcc0 2023-11-24T07:58:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1da37fe640 1 --2- 172.21.15.5:0/57595586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da406e440 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1da4070080 tx=0x7f1d9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4748a8e2c96e08b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1da2ffd640 1 -- 172.21.15.5:0/57595586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980a7070 con 0x7f1da406dfd0 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1da2ffd640 1 -- 172.21.15.5:0/57595586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d980ab430 con 0x7f1da406dfd0 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1da2ffd640 1 -- 172.21.15.5:0/57595586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980ab7c0 con 0x7f1da406dfd0 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 -- 172.21.15.5:0/57595586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 msgr2=0x7f1da406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 --2- 172.21.15.5:0/57595586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da406e440 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1da4070080 tx=0x7f1d9801c430 comp rx=0 tx=0).stop 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 -- 172.21.15.5:0/57595586 shutdown_connections 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 --2- 172.21.15.5:0/57595586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da406e440 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 --2- 172.21.15.5:0/57595586 >> v2:172.21.15.102:3300/0 conn(0x7f1da4143ae0 0x7f1da40b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 -- 172.21.15.5:0/57595586 >> 172.21.15.5:0/57595586 conn(0x7f1da40b0c40 msgr2=0x7f1da40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 -- 172.21.15.5:0/57595586 shutdown_connections 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 -- 172.21.15.5:0/57595586 wait complete. 2023-11-24T07:58:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.672+0000 7f1daa616640 1 Processor -- start 2023-11-24T07:58:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- start start 2023-11-24T07:58:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da40adcc0 0x7f1da4099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 0x7f1da409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da409a130 con 0x7f1da406dfd0 2023-11-24T07:58:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da413e420 con 0x7f1da4143ae0 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da413f7f0 con 0x7f1da40adcc0 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55904/0 (socket says 172.21.15.5:55904) 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 -- 172.21.15.5:0/3303936102 learned_addr learned my addr 172.21.15.5:0/3303936102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da37fe640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da40adcc0 0x7f1da4099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da8bb3640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 0x7f1da409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 -- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da40adcc0 msgr2=0x7f1da4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da40adcc0 0x7f1da4099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 -- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 msgr2=0x7f1da409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 0x7f1da409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 -- 172.21.15.5:0/3303936102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98009420 con 0x7f1da406dfd0 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da8bb3640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 0x7f1da409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da3fff640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e870 tx=0x7f1d9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94009510 con 0x7f1da406dfd0 2023-11-24T07:58:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400eec0 con 0x7f1da406dfd0 2023-11-24T07:58:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400cb40 con 0x7f1da406dfd0 2023-11-24T07:58:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da413fad0 con 0x7f1da406dfd0 2023-11-24T07:58:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da4140090 con 0x7f1da406dfd0 2023-11-24T07:58:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.676+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da404e850 con 0x7f1da406dfd0 2023-11-24T07:58:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.680+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d9400cca0 con 0x7f1da406dfd0 2023-11-24T07:58:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.680+0000 7f1da0ff9640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 0x7f1d90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.680+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1d94083ff0 con 0x7f1da406dfd0 2023-11-24T07:58:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.680+0000 7f1da37fe640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 0x7f1d90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.680+0000 7f1da37fe640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 0x7f1d90068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d980af000 tx=0x7f1d980a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.684+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d940517e0 con 0x7f1da406dfd0 2023-11-24T07:58:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.840+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1da4143ec0 con 0x7f1d90066470 2023-11-24T07:58:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.840+0000 7f1da0ff9640 1 -- 172.21.15.5:0/3303936102 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50405 (secure 0 0 0) 0x7f1d980ab8e0 con 0x7f1d90066470 2023-11-24T07:58:11.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:58:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 msgr2=0x7f1d90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 0x7f1d90068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d980af000 tx=0x7f1d980a7000 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 msgr2=0x7f1da413dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e870 tx=0x7f1d9400ec70 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 shutdown_connections 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1d90066470 0x7f1d90068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da4143ae0 0x7f1da409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da40adcc0 0x7f1da4099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 --2- 172.21.15.5:0/3303936102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1da406dfd0 0x7f1da413dba0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 >> 172.21.15.5:0/3303936102 conn(0x7f1da40b0c40 msgr2=0x7f1da40ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 shutdown_connections 2023-11-24T07:58:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:11.844+0000 7f1daa616640 1 -- 172.21.15.5:0/3303936102 wait complete. 2023-11-24T07:58:11.902 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-11-24T07:58:11.252796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237300,"kb_used_data":4488,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737420,"statfs":{"total":773094113280,"available":772851118080,"internally_reserved":0,"allocated":4595712,"data_stored":2527479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.065738"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T07:58:03.190365+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:58:03.190365+0000","last_peered":"2023-11-24T07:58:03.190365+0000","last_clean":"2023-11-24T07:58:03.190365+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:58:03.190365+0000","last_undegraded":"2023-11-24T07:58:03.190365+0000","last_fullsized":"2023-11-24T07:58:03.190365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.746},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.629}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78700000000000003}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.874}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.749},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.91400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.505},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.751}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":758897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.502}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:58:11.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:58:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 Processor -- start 2023-11-24T07:58:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 -- start start 2023-11-24T07:58:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f287815d7b0 0x7f28780d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780cefd0 con 0x7f28780d2080 2023-11-24T07:58:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780cf2b0 con 0x7f28780cead0 2023-11-24T07:58:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ec9c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287806b3f0 con 0x7f287815d7b0 2023-11-24T07:58:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287d239640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28780d2080 0x7f287806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59702/0 (socket says 172.21.15.5:59702) 2023-11-24T07:58:12.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287d239640 1 -- 172.21.15.5:0/1778599953 learned_addr learned my addr 172.21.15.5:0/1778599953 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:12.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ca38640 1 --2- 172.21.15.5:0/1778599953 >> v2:172.21.15.102:3300/0 conn(0x7f287815d7b0 0x7f28780d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082054062 0 0) 0x7f28780cefd0 con 0x7f28780d2080 2023-11-24T07:58:12.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003530 con 0x7f28780d2080 2023-11-24T07:58:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770114228 0 0) 0x7f2860003530 con 0x7f28780d2080 2023-11-24T07:58:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 >> v2:172.21.15.102:3300/0 conn(0x7f287815d7b0 msgr2=0x7f28780d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 --2- 172.21.15.5:0/1778599953 >> v2:172.21.15.102:3300/0 conn(0x7f287815d7b0 0x7f28780d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 >> v1:172.21.15.102:6789/0 conn(0x7f28780cead0 legacy=0x7f28780d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287806b6d0 con 0x7f28780d2080 2023-11-24T07:58:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 167498224 0 0) 0x7f2870001a00 con 0x7f28780d2080 2023-11-24T07:58:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 >> v1:172.21.15.5:6789/0 conn(0x7f28780d2080 legacy=0x7f287806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2860003980 0x7f2860003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 0x7f2860004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600052b0 0x7f286000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287806b3f0 con 0x7f28600052b0 2023-11-24T07:58:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286000c180 con 0x7f2860003980 2023-11-24T07:58:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286000c340 con 0x7f28600047d0 2023-11-24T07:58:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287ca38640 1 --2- 172.21.15.5:0/1778599953 >> v2:172.21.15.102:3300/0 conn(0x7f287815d7b0 0x7f28780d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f287d239640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600052b0 0x7f286000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.044+0000 7f286ffff640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 0x7f2860004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f287ca38640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2860003980 0x7f2860003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 -- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2860003980 msgr2=0x7f2860003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2860003980 0x7f2860003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 -- 172.21.15.5:0/1778599953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600052b0 msgr2=0x7f286000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600052b0 0x7f286000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 -- 172.21.15.5:0/1778599953 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860003530 con 0x7f28600047d0 2023-11-24T07:58:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f287d239640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600052b0 0x7f286000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f287d239640 1 -- 172.21.15.5:0/1778599953 reap_dead start 2023-11-24T07:58:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286ffff640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 0x7f2860004c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28780cef00 tx=0x7f286801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a09fbdce2c6aa4f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680052d0 con 0x7f28600047d0 2023-11-24T07:58:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28680a7050 con 0x7f28600047d0 2023-11-24T07:58:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.048+0000 7f286f7fe640 1 -- 172.21.15.5:0/1778599953 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868003600 con 0x7f28600047d0 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 msgr2=0x7f2860004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 0x7f2860004c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28780cef00 tx=0x7f286801c350 comp rx=0 tx=0).stop 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- 172.21.15.5:0/1778599953 shutdown_connections 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 --2- 172.21.15.5:0/1778599953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28600047d0 0x7f2860004c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- 172.21.15.5:0/1778599953 >> 172.21.15.5:0/1778599953 conn(0x7f28780d33b0 msgr2=0x7f28780d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- 172.21.15.5:0/1778599953 shutdown_connections 2023-11-24T07:58:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- 172.21.15.5:0/1778599953 wait complete. 2023-11-24T07:58:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 Processor -- start 2023-11-24T07:58:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- start start 2023-11-24T07:58:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28780ca4f0 0x7f28780b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 0x7f28780b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781581a0 con 0x7f28600047d0 2023-11-24T07:58:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28780b4810 con 0x7f28780b4360 2023-11-24T07:58:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ec9c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2878157520 con 0x7f28780ca4f0 2023-11-24T07:58:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55914/0 (socket says 172.21.15.5:55914) 2023-11-24T07:58:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 -- 172.21.15.5:0/2691653224 learned_addr learned my addr 172.21.15.5:0/2691653224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287d239640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 0x7f28780b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f286ffff640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28780ca4f0 0x7f28780b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 -- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28780ca4f0 msgr2=0x7f28780b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28780ca4f0 0x7f28780b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 -- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 msgr2=0x7f28780b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 0x7f28780b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287ca38640 1 -- 172.21.15.5:0/2691653224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878157800 con 0x7f28600047d0 2023-11-24T07:58:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.052+0000 7f287d239640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 0x7f28780b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f287ca38640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2874011cd0 tx=0x7f287400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400fd20 con 0x7f28600047d0 2023-11-24T07:58:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400fe80 con 0x7f28600047d0 2023-11-24T07:58:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878157ae0 con 0x7f28600047d0 2023-11-24T07:58:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004270 con 0x7f28600047d0 2023-11-24T07:58:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781569d0 con 0x7f28600047d0 2023-11-24T07:58:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287804e850 con 0x7f28600047d0 2023-11-24T07:58:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28740043d0 con 0x7f28600047d0 2023-11-24T07:58:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 0x7f2864068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28740844c0 con 0x7f28600047d0 2023-11-24T07:58:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.056+0000 7f286ffff640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 0x7f2864068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.060+0000 7f286ffff640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 0x7f2864068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28600057b0 tx=0x7f28680011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.060+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2874051b10 con 0x7f28600047d0 2023-11-24T07:58:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.216+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28780b3520 con 0x7f2864066470 2023-11-24T07:58:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f286d7fa640 1 -- 172.21.15.5:0/2691653224 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50405 (secure 0 0 0) 0x7f28780b3520 con 0x7f2864066470 2023-11-24T07:58:12.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:58:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 msgr2=0x7f2864068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 0x7f2864068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28600057b0 tx=0x7f28680011a0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 msgr2=0x7f2878156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2874011cd0 tx=0x7f287400f610 comp rx=0 tx=0).stop 2023-11-24T07:58:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 shutdown_connections 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f2864066470 0x7f2864068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28780b4360 0x7f28780b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28780ca4f0 0x7f28780b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 --2- 172.21.15.5:0/2691653224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28600047d0 0x7f2878156490 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 >> 172.21.15.5:0/2691653224 conn(0x7f28780d33b0 msgr2=0x7f28780b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 shutdown_connections 2023-11-24T07:58:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.220+0000 7f287ec9c640 1 -- 172.21.15.5:0/2691653224 wait complete. 2023-11-24T07:58:12.244 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-11-24T07:58:11.252796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237300,"kb_used_data":4488,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737420,"statfs":{"total":773094113280,"available":772851118080,"internally_reserved":0,"allocated":4595712,"data_stored":2527479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.065738"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T07:58:03.190365+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:58:03.190365+0000","last_peered":"2023-11-24T07:58:03.190365+0000","last_clean":"2023-11-24T07:58:03.190365+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:58:03.190365+0000","last_undegraded":"2023-11-24T07:58:03.190365+0000","last_fullsized":"2023-11-24T07:58:03.190365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.746},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.629}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78700000000000003}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.874}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.749},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.91400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.505},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.751}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":758897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.502}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:58:12.246 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T07:58:12.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:58:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.384+0000 7fee68a06640 1 Processor -- start 2023-11-24T07:58:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee68a06640 1 -- start start 2023-11-24T07:58:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee68a06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 0x7fee6406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee68a06640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640ae7f0 con 0x7fee6406dfd0 2023-11-24T07:58:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee68a06640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6406e980 con 0x7fee64143ae0 2023-11-24T07:58:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee68a06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64070670 con 0x7fee640ae3d0 2023-11-24T07:58:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee5bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee6406dfd0 0x7fee640adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59704/0 (socket says 172.21.15.5:59704) 2023-11-24T07:58:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee5bfff640 1 -- 172.21.15.5:0/863492340 learned_addr learned my addr 172.21.15.5:0/863492340 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee62d9d640 1 --2- 172.21.15.5:0/863492340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 0x7fee6406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860100452 0 0) 0x7fee640ae7f0 con 0x7fee6406dfd0 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee50005740 con 0x7fee6406dfd0 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092065470 0 0) 0x7fee6406e980 con 0x7fee64143ae0 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640ae7f0 con 0x7fee64143ae0 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee62d9d640 1 -- 172.21.15.5:0/863492340 >> v1:172.21.15.102:6789/0 conn(0x7fee64143ae0 legacy=0x7fee640b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee62d9d640 1 -- 172.21.15.5:0/863492340 >> v1:172.21.15.5:6789/0 conn(0x7fee6406dfd0 legacy=0x7fee640adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.388+0000 7fee62d9d640 1 -- 172.21.15.5:0/863492340 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64070950 con 0x7fee640ae3d0 2023-11-24T07:58:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee62d9d640 1 --2- 172.21.15.5:0/863492340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 0x7fee6406e440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009dc0 tx=0x7fee5c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc71035e6d67b703 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0a5a00 con 0x7fee640ae3d0 2023-11-24T07:58:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0a5b60 con 0x7fee640ae3d0 2023-11-24T07:58:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee61d9b640 1 -- 172.21.15.5:0/863492340 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ad440 con 0x7fee640ae3d0 2023-11-24T07:58:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 -- 172.21.15.5:0/863492340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 msgr2=0x7fee6406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 --2- 172.21.15.5:0/863492340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 0x7fee6406e440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009dc0 tx=0x7fee5c01c940 comp rx=0 tx=0).stop 2023-11-24T07:58:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 -- 172.21.15.5:0/863492340 shutdown_connections 2023-11-24T07:58:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 --2- 172.21.15.5:0/863492340 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee640ae3d0 0x7fee6406e440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 -- 172.21.15.5:0/863492340 >> 172.21.15.5:0/863492340 conn(0x7fee640b0c40 msgr2=0x7fee640b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 -- 172.21.15.5:0/863492340 shutdown_connections 2023-11-24T07:58:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.392+0000 7fee68a06640 1 -- 172.21.15.5:0/863492340 wait complete. 2023-11-24T07:58:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 Processor -- start 2023-11-24T07:58:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- start start 2023-11-24T07:58:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee640ae3d0 0x7fee64142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 0x7fee64136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640b3300 con 0x7fee64143ae0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee64151280 con 0x7fee640ae3d0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640b2780 con 0x7fee6406dfd0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 0x7fee64136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee5bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee640ae3d0 0x7fee64142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:49724/0 (socket says 172.21.15.5:49724) 2023-11-24T07:58:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 -- 172.21.15.5:0/2148807725 learned_addr learned my addr 172.21.15.5:0/2148807725 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 -- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee640ae3d0 msgr2=0x7fee64142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee640ae3d0 0x7fee64142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 -- 172.21.15.5:0/2148807725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 msgr2=0x7fee64136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 0x7fee64136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 -- 172.21.15.5:0/2148807725 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009a70 con 0x7fee6406dfd0 2023-11-24T07:58:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee62d9d640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 0x7fee64136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee6259c640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c430 tx=0x7fee5400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54001180 con 0x7fee6406dfd0 2023-11-24T07:58:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540052d0 con 0x7fee6406dfd0 2023-11-24T07:58:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54003840 con 0x7fee6406dfd0 2023-11-24T07:58:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640b2a60 con 0x7fee6406dfd0 2023-11-24T07:58:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee641517e0 con 0x7fee6406dfd0 2023-11-24T07:58:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.396+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6404e850 con 0x7fee6406dfd0 2023-11-24T07:58:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.400+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee540039a0 con 0x7fee6406dfd0 2023-11-24T07:58:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.400+0000 7fee5affd640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.400+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee540831e0 con 0x7fee6406dfd0 2023-11-24T07:58:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.400+0000 7fee5bfff640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.400+0000 7fee5bfff640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 0x7fee44068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee6413c070 tx=0x7fee4c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.404+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee54050970 con 0x7fee6406dfd0 2023-11-24T07:58:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.556+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee64143ec0 con 0x7fee44066470 2023-11-24T07:58:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee5affd640 1 -- 172.21.15.5:0/2148807725 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50405 (secure 0 0 0) 0x7fee4c001510 con 0x7fee44066470 2023-11-24T07:58:12.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:58:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 msgr2=0x7fee44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 0x7fee44068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee6413c070 tx=0x7fee4c007d60 comp rx=0 tx=0).stop 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 msgr2=0x7fee64142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c430 tx=0x7fee5400c8f0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 shutdown_connections 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee64143ae0 0x7fee64136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee640ae3d0 0x7fee64142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 --2- 172.21.15.5:0/2148807725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee6406dfd0 0x7fee64142590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 >> 172.21.15.5:0/2148807725 conn(0x7fee640b0c40 msgr2=0x7fee640b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 shutdown_connections 2023-11-24T07:58:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.560+0000 7fee68a06640 1 -- 172.21.15.5:0/2148807725 wait complete. 2023-11-24T07:58:12.585 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-11-24T07:58:11.252796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237300,"kb_used_data":4488,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737420,"statfs":{"total":773094113280,"available":772851118080,"internally_reserved":0,"allocated":4595712,"data_stored":2527479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.065738"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T07:58:03.190365+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:58:03.190365+0000","last_peered":"2023-11-24T07:58:03.190365+0000","last_clean":"2023-11-24T07:58:03.190365+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:58:03.190365+0000","last_undegraded":"2023-11-24T07:58:03.190365+0000","last_fullsized":"2023-11-24T07:58:03.190365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.746},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.629}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78700000000000003}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.874}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.749},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.91400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.505},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.751}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":758897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.502}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:58:12.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T07:58:12.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.724+0000 7f13d44f7640 1 Processor -- start 2023-11-24T07:58:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.724+0000 7f13d44f7640 1 -- start start 2023-11-24T07:58:12.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d44f7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d44f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13cc0b44b0 0x7f13cc0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d44f7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc0b4c70 con 0x7f13cc0ce160 2023-11-24T07:58:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d44f7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc0b5d10 con 0x7f13cc0b44b0 2023-11-24T07:58:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d44f7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0ce5f0 con 0x7f13cc144cf0 2023-11-24T07:58:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13cc0b44b0 0x7f13cc0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13cc0b44b0 0x7f13cc0cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55934/0 (socket says 172.21.15.5:55934) 2023-11-24T07:58:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 -- 172.21.15.5:0/4096414408 learned_addr learned my addr 172.21.15.5:0/4096414408 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d2293640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 -- 172.21.15.5:0/4096414408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 msgr2=0x7f13cc070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 -- 172.21.15.5:0/4096414408 >> v1:172.21.15.102:6789/0 conn(0x7f13cc0ce160 legacy=0x7f13cc15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1a92640 1 -- 172.21.15.5:0/4096414408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0b4f50 con 0x7f13cc0b44b0 2023-11-24T07:58:12.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.728+0000 7f13d1291640 1 -- 172.21.15.5:0/4096414408 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242782560 0 0) 0x7f13cc0b4c70 con 0x7f13cc0ce160 2023-11-24T07:58:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d1a92640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0b44b0 0x7f13cc0cdc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009870 tx=0x7f13bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2731785fa5122f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d1291640 1 -- 172.21.15.5:0/4096414408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0aa670 con 0x7f13cc0b44b0 2023-11-24T07:58:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d1291640 1 -- 172.21.15.5:0/4096414408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc0aa7d0 con 0x7f13cc0b44b0 2023-11-24T07:58:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d1291640 1 -- 172.21.15.5:0/4096414408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0aab60 con 0x7f13cc0b44b0 2023-11-24T07:58:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- 172.21.15.5:0/4096414408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0b44b0 msgr2=0x7f13cc0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0b44b0 0x7f13cc0cdc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009870 tx=0x7f13bc01c510 comp rx=0 tx=0).stop 2023-11-24T07:58:12.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- 172.21.15.5:0/4096414408 shutdown_connections 2023-11-24T07:58:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0b44b0 0x7f13cc0cdc20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 --2- 172.21.15.5:0/4096414408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- 172.21.15.5:0/4096414408 >> 172.21.15.5:0/4096414408 conn(0x7f13cc0b2ea0 msgr2=0x7f13cc0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- 172.21.15.5:0/4096414408 shutdown_connections 2023-11-24T07:58:12.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- 172.21.15.5:0/4096414408 wait complete. 2023-11-24T07:58:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 Processor -- start 2023-11-24T07:58:12.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.732+0000 7f13d44f7640 1 -- start start 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13cc0b44b0 0x7f13cc159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc15a2b0 con 0x7f13cc0ce160 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc15e8e0 con 0x7f13cc0b44b0 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc15ebc0 con 0x7f13cc144cf0 2023-11-24T07:58:12.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55942/0 (socket says 172.21.15.5:55942) 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 -- 172.21.15.5:0/2865602900 learned_addr learned my addr 172.21.15.5:0/2865602900 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d2293640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13cc0b44b0 0x7f13cc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d2a94640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 -- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 msgr2=0x7f13cc143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 -- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13cc0b44b0 msgr2=0x7f13cc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13cc0b44b0 0x7f13cc159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 -- 172.21.15.5:0/2865602900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0094d0 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d2a94640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d1a92640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13bc01a140 tx=0x7f13bc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0aa670 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc0b3800 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0b3bb0 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc15eea0 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc15f460 con 0x7f13cc0ce160 2023-11-24T07:58:12.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc04e850 con 0x7f13cc0ce160 2023-11-24T07:58:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.736+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13bc0b3d10 con 0x7f13cc0ce160 2023-11-24T07:58:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.740+0000 7f13c2ffd640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 0x7f13b0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.740+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13bc11e6b0 con 0x7f13cc0ce160 2023-11-24T07:58:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.740+0000 7f13d2293640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 0x7f13b0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:12.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.740+0000 7f13d2293640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 0x7f13b0068980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009ac0 tx=0x7f13c8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:12.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.744+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13bc0ebfd0 con 0x7f13cc0ce160 2023-11-24T07:58:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13cc144500 con 0x7f13cc0ce160 2023-11-24T07:58:12.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13c2ffd640 1 -- 172.21.15.5:0/2865602900 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f13bc0ef5f0 con 0x7f13cc0ce160 2023-11-24T07:58:12.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:12.904 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"c1c5da79-7f10-46d9-a2ce-04e64f4e6baf","created":"2023-11-24T07:56:24.164501+0000","modified":"2023-11-24T07:58:04.183911+0000","last_up_change":"2023-11-24T07:56:36.081997+0000","last_in_change":"2023-11-24T07:56:26.725216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T07:56:37.301032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43bcdb14-2055-47ff-b134-3f90a5ae247c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6817","nonce":2976979729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6819","nonce":2976979729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6823","nonce":2976979729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2976979729},{"type":"v1","addr":"172.21.15.5:6821","nonce":2976979729}]},"public_addr":"172.21.15.5:6817/2976979729","cluster_addr":"172.21.15.5:6819/2976979729","heartbeat_back_addr":"172.21.15.5:6823/2976979729","heartbeat_front_addr":"172.21.15.5:6821/2976979729","state":["exists","up"]},{"osd":1,"uuid":"ddd67eff-e078-4a3d-86ac-1dd32569287e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6809","nonce":2581618312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6811","nonce":2581618312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6815","nonce":2581618312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2581618312},{"type":"v1","addr":"172.21.15.5:6813","nonce":2581618312}]},"public_addr":"172.21.15.5:6809/2581618312","cluster_addr":"172.21.15.5:6811/2581618312","heartbeat_back_addr":"172.21.15.5:6815/2581618312","heartbeat_front_addr":"172.21.15.5:6813/2581618312","state":["exists","up"]},{"osd":2,"uuid":"a5091443-e10c-4bc9-b567-29409ea7608a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6801","nonce":3596801206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6803","nonce":3596801206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6807","nonce":3596801206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3596801206},{"type":"v1","addr":"172.21.15.5:6805","nonce":3596801206}]},"public_addr":"172.21.15.5:6801/3596801206","cluster_addr":"172.21.15.5:6803/3596801206","heartbeat_back_addr":"172.21.15.5:6807/3596801206","heartbeat_front_addr":"172.21.15.5:6805/3596801206","state":["exists","up"]},{"osd":3,"uuid":"17465a15-308d-4381-937c-9fda62a88e74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6825","nonce":4161007531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6827","nonce":4161007531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6831","nonce":4161007531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4161007531},{"type":"v1","addr":"172.21.15.5:6829","nonce":4161007531}]},"public_addr":"172.21.15.5:6825/4161007531","cluster_addr":"172.21.15.5:6827/4161007531","heartbeat_back_addr":"172.21.15.5:6831/4161007531","heartbeat_front_addr":"172.21.15.5:6829/4161007531","state":["exists","up"]},{"osd":4,"uuid":"496a8096-a74d-4544-8181-82af64cb4549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6801","nonce":401703187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6803","nonce":401703187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6807","nonce":401703187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":401703187},{"type":"v1","addr":"172.21.15.102:6805","nonce":401703187}]},"public_addr":"172.21.15.102:6801/401703187","cluster_addr":"172.21.15.102:6803/401703187","heartbeat_back_addr":"172.21.15.102:6807/401703187","heartbeat_front_addr":"172.21.15.102:6805/401703187","state":["exists","up"]},{"osd":5,"uuid":"7e8ee2db-1311-4e79-ac74-948deb99d7a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6810","nonce":2731741621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6814","nonce":2731741621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6822","nonce":2731741621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2731741621},{"type":"v1","addr":"172.21.15.102:6818","nonce":2731741621}]},"public_addr":"172.21.15.102:6810/2731741621","cluster_addr":"172.21.15.102:6814/2731741621","heartbeat_back_addr":"172.21.15.102:6822/2731741621","heartbeat_front_addr":"172.21.15.102:6818/2731741621","state":["exists","up"]},{"osd":6,"uuid":"075db409-227d-4df1-afba-9177b0bda347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6811","nonce":2249940910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6815","nonce":2249940910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6823","nonce":2249940910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2249940910},{"type":"v1","addr":"172.21.15.102:6819","nonce":2249940910}]},"public_addr":"172.21.15.102:6811/2249940910","cluster_addr":"172.21.15.102:6815/2249940910","heartbeat_back_addr":"172.21.15.102:6823/2249940910","heartbeat_front_addr":"172.21.15.102:6819/2249940910","state":["exists","up"]},{"osd":7,"uuid":"fc0e2708-a0c0-462a-b902-c294b8ec7d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6825","nonce":1162611146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6827","nonce":1162611146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6831","nonce":1162611146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1162611146},{"type":"v1","addr":"172.21.15.102:6829","nonce":1162611146}]},"public_addr":"172.21.15.102:6825/1162611146","cluster_addr":"172.21.15.102:6827/1162611146","heartbeat_back_addr":"172.21.15.102:6831/1162611146","heartbeat_front_addr":"172.21.15.102:6829/1162611146","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.486741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.495167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.317998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.508042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.620087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.454550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.450558+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T07:56:32.487715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1586527042":"2023-11-25T07:58:01.171458+0000","172.21.15.5:6834/1586527042":"2023-11-25T07:58:01.171458+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T07:58:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 msgr2=0x7f13b0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 0x7f13b0068980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009ac0 tx=0x7f13c8009190 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 msgr2=0x7f13cc142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13bc01a140 tx=0x7f13bc01ad50 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 shutdown_connections 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f13b00664c0 0x7f13b0068980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13cc144cf0 0x7f13cc143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13cc0ce160 0x7f13cc142ec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 --2- 172.21.15.5:0/2865602900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13cc0b44b0 0x7f13cc159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 >> 172.21.15.5:0/2865602900 conn(0x7f13cc0b2ea0 msgr2=0x7f13cc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 shutdown_connections 2023-11-24T07:58:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:12.900+0000 7f13d44f7640 1 -- 172.21.15.5:0/2865602900 wait complete. 2023-11-24T07:58:13.925 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T07:58:13.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.080+0000 7f56e718d640 1 Processor -- start 2023-11-24T07:58:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.080+0000 7f56e718d640 1 -- start start 2023-11-24T07:58:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e718d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 0x7f56e00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e718d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 0x7f56e00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e718d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00b2710 con 0x7f56e015a710 2023-11-24T07:58:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e718d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00cca80 con 0x7f56e00cdfb0 2023-11-24T07:58:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e718d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00b29f0 con 0x7f56e00cbd50 2023-11-24T07:58:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56dffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56e015a710 0x7f56e00ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59718/0 (socket says 172.21.15.5:59718) 2023-11-24T07:58:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56dffff640 1 -- 172.21.15.5:0/2211501057 learned_addr learned my addr 172.21.15.5:0/2211501057 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e4f29640 1 --2- 172.21.15.5:0/2211501057 >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 0x7f56e00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e572a640 1 --2- 172.21.15.5:0/2211501057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 0x7f56e00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56df7fe640 1 -- 172.21.15.5:0/2211501057 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629115430 0 0) 0x7f56e00b2710 con 0x7f56e015a710 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56df7fe640 1 -- 172.21.15.5:0/2211501057 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d0005740 con 0x7f56e015a710 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e572a640 1 -- 172.21.15.5:0/2211501057 >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 msgr2=0x7f56e00abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e572a640 1 --2- 172.21.15.5:0/2211501057 >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 0x7f56e00abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e572a640 1 -- 172.21.15.5:0/2211501057 >> v1:172.21.15.5:6789/0 conn(0x7f56e015a710 legacy=0x7f56e00ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e572a640 1 -- 172.21.15.5:0/2211501057 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00b2cd0 con 0x7f56e00cbd50 2023-11-24T07:58:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.084+0000 7f56e4f29640 1 --2- 172.21.15.5:0/2211501057 >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 0x7f56e00abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e572a640 1 --2- 172.21.15.5:0/2211501057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 0x7f56e00cc1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009d90 tx=0x7f56d801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1e84ef34dbc8dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56df7fe640 1 -- 172.21.15.5:0/2211501057 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80a5a00 con 0x7f56e00cbd50 2023-11-24T07:58:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56df7fe640 1 -- 172.21.15.5:0/2211501057 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d80a5b60 con 0x7f56e00cbd50 2023-11-24T07:58:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56df7fe640 1 -- 172.21.15.5:0/2211501057 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80ad440 con 0x7f56e00cbd50 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- 172.21.15.5:0/2211501057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 msgr2=0x7f56e00cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 --2- 172.21.15.5:0/2211501057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 0x7f56e00cc1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009d90 tx=0x7f56d801c920 comp rx=0 tx=0).stop 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- 172.21.15.5:0/2211501057 shutdown_connections 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 --2- 172.21.15.5:0/2211501057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e00cbd50 0x7f56e00cc1e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 --2- 172.21.15.5:0/2211501057 >> v2:172.21.15.102:3300/0 conn(0x7f56e00cdfb0 0x7f56e00abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- 172.21.15.5:0/2211501057 >> 172.21.15.5:0/2211501057 conn(0x7f56e00b0cb0 msgr2=0x7f56e00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- 172.21.15.5:0/2211501057 shutdown_connections 2023-11-24T07:58:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- 172.21.15.5:0/2211501057 wait complete. 2023-11-24T07:58:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 Processor -- start 2023-11-24T07:58:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.088+0000 7f56e718d640 1 -- start start 2023-11-24T07:58:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 0x7f56e01490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56e00cdfb0 0x7f56e00cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e015a710 0x7f56e01f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0147460 con 0x7f56e00cbd50 2023-11-24T07:58:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01499c0 con 0x7f56e00cdfb0 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0149ca0 con 0x7f56e015a710 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 0x7f56e01490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 0x7f56e01490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55950/0 (socket says 172.21.15.5:55950) 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 -- 172.21.15.5:0/457931244 learned_addr learned my addr 172.21.15.5:0/457931244 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dffff640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56e00cdfb0 0x7f56e00cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e572a640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e015a710 0x7f56e01f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 -- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e015a710 msgr2=0x7f56e01f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56e015a710 0x7f56e01f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 -- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56e00cdfb0 msgr2=0x7f56e00cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56e00cdfb0 0x7f56e00cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009420 con 0x7f56e00cbd50 2023-11-24T07:58:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dffff640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56e00cdfb0 0x7f56e00cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e4f29640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 0x7f56e01490e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f56d400ebe0 tx=0x7f56d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400eee0 con 0x7f56e00cbd50 2023-11-24T07:58:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400cc30 con 0x7f56e00cbd50 2023-11-24T07:58:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4013470 con 0x7f56e00cbd50 2023-11-24T07:58:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d8009a70 con 0x7f56e00cbd50 2023-11-24T07:58:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01470f0 con 0x7f56e00cbd50 2023-11-24T07:58:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56e006b460 con 0x7f56e00cbd50 2023-11-24T07:58:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.092+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56d40135d0 con 0x7f56e00cbd50 2023-11-24T07:58:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56c40664a0 0x7f56c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56d4083e80 con 0x7f56e00cbd50 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f56c406c300 0x7f56c406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56c406edd0 con 0x7f56c406c300 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56d4086460 con 0x7f56e00cbd50 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56e572a640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f56c406c300 0x7f56c406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dffff640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56c40664a0 0x7f56c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56e572a640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f56c406c300 0x7f56c406e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dffff640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56c40664a0 0x7f56c4068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b1be0 tx=0x7f56cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.096+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== osd.0 v2:172.21.15.5:6816/2976979729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f56c406edd0 con 0x7f56c406c300 2023-11-24T07:58:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.108+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 --> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56e01475a0 con 0x7f56c406c300 2023-11-24T07:58:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56dd7fa640 1 -- 172.21.15.5:0/457931244 <== osd.0 v2:172.21.15.5:6816/2976979729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f56d8009450 con 0x7f56c406c300 2023-11-24T07:58:14.114 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:14.115 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f56c406c300 msgr2=0x7f56c406e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:6816/2976979729,v1:172.21.15.5:6817/2976979729] conn(0x7f56c406c300 0x7f56c406e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56c40664a0 msgr2=0x7f56c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f56c40664a0 0x7f56c4068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b1be0 tx=0x7f56cc009040 comp rx=0 tx=0).stop 2023-11-24T07:58:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 msgr2=0x7f56e01490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 --2- 172.21.15.5:0/457931244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e00cbd50 0x7f56e01490e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f56d400ebe0 tx=0x7f56d400c520 comp rx=0 tx=0).stop 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e572a640 1 -- 172.21.15.5:0/457931244 reap_dead start 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 shutdown_connections 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 >> 172.21.15.5:0/457931244 conn(0x7f56e00b0cb0 msgr2=0x7f56e00acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 shutdown_connections 2023-11-24T07:58:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.112+0000 7f56e718d640 1 -- 172.21.15.5:0/457931244 wait complete. 2023-11-24T07:58:14.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T07:58:14.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:14.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 Processor -- start 2023-11-24T07:58:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 -- start start 2023-11-24T07:58:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83a80b07a0 0x7f83a81619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83a8161f20 0x7f83a80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a8161290 con 0x7f83a80b2870 2023-11-24T07:58:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80b0b80 con 0x7f83a8161f20 2023-11-24T07:58:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83aebc1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a815ebc0 con 0x7f83a80b07a0 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83a8161f20 0x7f83a80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83a8161f20 0x7f83a80b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55962/0 (socket says 172.21.15.5:55962) 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83a7fff640 1 -- 172.21.15.5:0/2034988862 learned_addr learned my addr 172.21.15.5:0/2034988862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.288+0000 7f83ac95d640 1 --2- 172.21.15.5:0/2034988862 >> v2:172.21.15.102:3300/0 conn(0x7f83a80b07a0 0x7f83a81619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a7fff640 1 -- 172.21.15.5:0/2034988862 >> v2:172.21.15.102:3300/0 conn(0x7f83a80b07a0 msgr2=0x7f83a81619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a7fff640 1 --2- 172.21.15.5:0/2034988862 >> v2:172.21.15.102:3300/0 conn(0x7f83a80b07a0 0x7f83a81619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a7fff640 1 -- 172.21.15.5:0/2034988862 >> v1:172.21.15.102:6789/0 conn(0x7f83a80b2870 legacy=0x7f83a80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a7fff640 1 -- 172.21.15.5:0/2034988862 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8161550 con 0x7f83a8161f20 2023-11-24T07:58:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a7fff640 1 --2- 172.21.15.5:0/2034988862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a80b0ee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83a806c6a0 tx=0x7f839401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fd9c93b6705fa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a77fe640 1 -- 172.21.15.5:0/2034988862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940ab5f0 con 0x7f83a8161f20 2023-11-24T07:58:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a77fe640 1 -- 172.21.15.5:0/2034988862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940ab750 con 0x7f83a8161f20 2023-11-24T07:58:14.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83a77fe640 1 -- 172.21.15.5:0/2034988862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940abae0 con 0x7f83a8161f20 2023-11-24T07:58:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83aebc1640 1 -- 172.21.15.5:0/2034988862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 msgr2=0x7f83a80b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.292+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2034988862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a80b0ee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83a806c6a0 tx=0x7f839401c500 comp rx=0 tx=0).stop 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- 172.21.15.5:0/2034988862 shutdown_connections 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2034988862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a80b0ee0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2034988862 >> v2:172.21.15.102:3300/0 conn(0x7f83a80b07a0 0x7f83a81619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- 172.21.15.5:0/2034988862 >> 172.21.15.5:0/2034988862 conn(0x7f83a80b1d50 msgr2=0x7f83a80b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- 172.21.15.5:0/2034988862 shutdown_connections 2023-11-24T07:58:14.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- 172.21.15.5:0/2034988862 wait complete. 2023-11-24T07:58:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 Processor -- start 2023-11-24T07:58:14.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- start start 2023-11-24T07:58:14.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 0x7f83a814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83a80b2870 0x7f83a8156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8155a40 con 0x7f83a8161f20 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a814c710 con 0x7f83a80b07a0 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83aebc1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8157220 con 0x7f83a80b2870 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ad15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 0x7f83a814c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ad15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55978/0 (socket says 172.21.15.5:55978) 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ad15e640 1 -- 172.21.15.5:0/2579518872 learned_addr learned my addr 172.21.15.5:0/2579518872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83a7fff640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83a80b2870 0x7f83a8156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 -- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83a80b2870 msgr2=0x7f83a8156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83a80b2870 0x7f83a8156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 -- 172.21.15.5:0/2579518872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 msgr2=0x7f83a8155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a8155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 -- 172.21.15.5:0/2579518872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940094d0 con 0x7f83a80b07a0 2023-11-24T07:58:14.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.296+0000 7f83ac95d640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 0x7f83a814c1d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e870 tx=0x7f839c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0095d0 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c00c940 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a81574c0 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00ccb0 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a8155660 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a804e850 con 0x7f83a80b07a0 2023-11-24T07:58:14.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f839c013470 con 0x7f83a80b07a0 2023-11-24T07:58:14.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f839c083c90 con 0x7f83a80b07a0 2023-11-24T07:58:14.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.300+0000 7f83a7fff640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.304+0000 7f83a7fff640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f83940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.308+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f839c0514b0 con 0x7f83a80b07a0 2023-11-24T07:58:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a8161db0 con 0x7f838c066470 2023-11-24T07:58:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83a57fa640 1 -- 172.21.15.5:0/2579518872 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83a8161db0 con 0x7f838c066470 2023-11-24T07:58:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T07:58:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 msgr2=0x7f838c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 0x7f838c068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f83940a7000 comp rx=0 tx=0).stop 2023-11-24T07:58:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 msgr2=0x7f83a814c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 0x7f83a814c1d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e870 tx=0x7f839c00ed30 comp rx=0 tx=0).stop 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 shutdown_connections 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f838c066470 0x7f838c068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a8161f20 0x7f83a8155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83a80b2870 0x7f83a8156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 --2- 172.21.15.5:0/2579518872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83a80b07a0 0x7f83a814c1d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 >> 172.21.15.5:0/2579518872 conn(0x7f83a80b1d50 msgr2=0x7f83a806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 shutdown_connections 2023-11-24T07:58:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.464+0000 7f83aebc1640 1 -- 172.21.15.5:0/2579518872 wait complete. 2023-11-24T07:58:14.488 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T07:58:14.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 Processor -- start 2023-11-24T07:58:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 -- start start 2023-11-24T07:58:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea015d610 0x7f4ea00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ea00caa60 0x7f4ea00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea00caec0 con 0x7f4ea006c520 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea006b970 con 0x7f4ea00caa60 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4ea5780640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea006bc50 con 0x7f4ea015d610 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ea00caa60 0x7f4ea00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ea00caa60 0x7f4ea00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55994/0 (socket says 172.21.15.5:55994) 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 -- 172.21.15.5:0/4155915096 learned_addr learned my addr 172.21.15.5:0/4155915096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9effd640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea015d610 0x7f4ea00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 -- 172.21.15.5:0/4155915096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea015d610 msgr2=0x7f4ea00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea015d610 0x7f4ea00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 -- 172.21.15.5:0/4155915096 >> v1:172.21.15.5:6789/0 conn(0x7f4ea006c520 legacy=0x7f4ea00d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.676+0000 7f4e9e7fc640 1 -- 172.21.15.5:0/4155915096 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00cfe60 con 0x7f4ea00caa60 2023-11-24T07:58:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4e9e7fc640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea00caa60 0x7f4ea00cb8d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009870 tx=0x7f4e9401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7692a84952b853f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4e9dffb640 1 -- 172.21.15.5:0/4155915096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940aa650 con 0x7f4ea00caa60 2023-11-24T07:58:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4e9dffb640 1 -- 172.21.15.5:0/4155915096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940aa7b0 con 0x7f4ea00caa60 2023-11-24T07:58:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4e9dffb640 1 -- 172.21.15.5:0/4155915096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940aab40 con 0x7f4ea00caa60 2023-11-24T07:58:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 -- 172.21.15.5:0/4155915096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea00caa60 msgr2=0x7f4ea00cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea00caa60 0x7f4ea00cb8d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009870 tx=0x7f4e9401c510 comp rx=0 tx=0).stop 2023-11-24T07:58:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 -- 172.21.15.5:0/4155915096 shutdown_connections 2023-11-24T07:58:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea00caa60 0x7f4ea00cb8d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 --2- 172.21.15.5:0/4155915096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea015d610 0x7f4ea00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 -- 172.21.15.5:0/4155915096 >> 172.21.15.5:0/4155915096 conn(0x7f4ea00b2f10 msgr2=0x7f4ea00b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 -- 172.21.15.5:0/4155915096 shutdown_connections 2023-11-24T07:58:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.680+0000 7f4ea5780640 1 -- 172.21.15.5:0/4155915096 wait complete. 2023-11-24T07:58:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 Processor -- start 2023-11-24T07:58:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- start start 2023-11-24T07:58:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ea006c520 0x7f4ea0149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea00caa60 0x7f4ea0147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 0x7f4ea0152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01489a0 con 0x7f4ea015d610 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0148c80 con 0x7f4ea006c520 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0148f60 con 0x7f4ea00caa60 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 0x7f4ea0152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 0x7f4ea0152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55998/0 (socket says 172.21.15.5:55998) 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 -- 172.21.15.5:0/1801835837 learned_addr learned my addr 172.21.15.5:0/1801835837 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9e7fc640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea00caa60 0x7f4ea0147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9effd640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ea006c520 0x7f4ea0149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 -- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea00caa60 msgr2=0x7f4ea0147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ea00caa60 0x7f4ea0147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 -- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ea006c520 msgr2=0x7f4ea0149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ea006c520 0x7f4ea0149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940094d0 con 0x7f4ea015d610 2023-11-24T07:58:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e9f7fe640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 0x7f4ea0152400 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c730 tx=0x7f4e9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98003b80 con 0x7f4ea015d610 2023-11-24T07:58:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98003ce0 con 0x7f4ea015d610 2023-11-24T07:58:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800aa30 con 0x7f4ea015d610 2023-11-24T07:58:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea006cec0 con 0x7f4ea015d610 2023-11-24T07:58:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.684+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea0149520 con 0x7f4ea015d610 2023-11-24T07:58:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ea006cd40 con 0x7f4ea015d610 2023-11-24T07:58:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e9800ab90 con 0x7f4ea015d610 2023-11-24T07:58:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4e8c066470 0x7f4e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e98083920 con 0x7f4ea015d610 2023-11-24T07:58:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7f4e8c06c2d0 0x7f4e8c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e8c06eda0 con 0x7f4e8c06c2d0 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e980882a0 con 0x7f4ea015d610 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e9effd640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4e8c066470 0x7f4e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e9e7fc640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7f4e8c06c2d0 0x7f4e8c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e9e7fc640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7f4e8c06c2d0 0x7f4e8c06e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e9effd640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4e8c066470 0x7f4e8c068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0156c80 tx=0x7f4e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.688+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== osd.1 v2:172.21.15.5:6808/2581618312 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4e8c06eda0 con 0x7f4e8c06c2d0 2023-11-24T07:58:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 --> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ea00cfb10 con 0x7f4e8c06c2d0 2023-11-24T07:58:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4e877fe640 1 -- 172.21.15.5:0/1801835837 <== osd.1 v2:172.21.15.5:6808/2581618312 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4e940aa610 con 0x7f4e8c06c2d0 2023-11-24T07:58:14.707 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:14.708 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:14.708 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7f4e8c06c2d0 msgr2=0x7f4e8c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:6808/2581618312,v1:172.21.15.5:6809/2581618312] conn(0x7f4e8c06c2d0 0x7f4e8c06e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4e8c066470 msgr2=0x7f4e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f4e8c066470 0x7f4e8c068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0156c80 tx=0x7f4e90008040 comp rx=0 tx=0).stop 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 msgr2=0x7f4ea0152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 --2- 172.21.15.5:0/1801835837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea015d610 0x7f4ea0152400 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c730 tx=0x7f4e9800cbf0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4e9f7fe640 1 -- 172.21.15.5:0/1801835837 reap_dead start 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 shutdown_connections 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 >> 172.21.15.5:0/1801835837 conn(0x7f4ea00b2f10 msgr2=0x7f4ea00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 shutdown_connections 2023-11-24T07:58:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.704+0000 7f4ea5780640 1 -- 172.21.15.5:0/1801835837 wait complete. 2023-11-24T07:58:14.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T07:58:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 Processor -- start 2023-11-24T07:58:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 -- start start 2023-11-24T07:58:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef200cc460 0x7fef200abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b2710 con 0x7fef2015a710 2023-11-24T07:58:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b29f0 con 0x7fef200cdfb0 2023-11-24T07:58:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef26816640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef200cca80 con 0x7fef200cc460 2023-11-24T07:58:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef1f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef2015a710 0x7fef200cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59726/0 (socket says 172.21.15.5:59726) 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef1f7fe640 1 -- 172.21.15.5:0/286218557 learned_addr learned my addr 172.21.15.5:0/286218557 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef24db3640 1 --2- 172.21.15.5:0/286218557 >> v2:172.21.15.102:3300/0 conn(0x7fef200cc460 0x7fef200abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef1effd640 1 -- 172.21.15.5:0/286218557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002774681 0 0) 0x7fef200b2710 con 0x7fef2015a710 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef1effd640 1 -- 172.21.15.5:0/286218557 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef08003530 con 0x7fef2015a710 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef24db3640 1 -- 172.21.15.5:0/286218557 >> v1:172.21.15.102:6789/0 conn(0x7fef200cdfb0 legacy=0x7fef200ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef24db3640 1 -- 172.21.15.5:0/286218557 >> v1:172.21.15.5:6789/0 conn(0x7fef2015a710 legacy=0x7fef200cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.868+0000 7fef24db3640 1 -- 172.21.15.5:0/286218557 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200b2cd0 con 0x7fef200cc460 2023-11-24T07:58:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef24db3640 1 --2- 172.21.15.5:0/286218557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cc460 0x7fef200abf90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef18009d90 tx=0x7fef1801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0c2998fecea6db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef1effd640 1 -- 172.21.15.5:0/286218557 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180a5a00 con 0x7fef200cc460 2023-11-24T07:58:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef1effd640 1 -- 172.21.15.5:0/286218557 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef180a5b60 con 0x7fef200cc460 2023-11-24T07:58:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef1effd640 1 -- 172.21.15.5:0/286218557 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180ad440 con 0x7fef200cc460 2023-11-24T07:58:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 -- 172.21.15.5:0/286218557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cc460 msgr2=0x7fef200abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 --2- 172.21.15.5:0/286218557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cc460 0x7fef200abf90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef18009d90 tx=0x7fef1801c920 comp rx=0 tx=0).stop 2023-11-24T07:58:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 -- 172.21.15.5:0/286218557 shutdown_connections 2023-11-24T07:58:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 --2- 172.21.15.5:0/286218557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cc460 0x7fef200abf90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 -- 172.21.15.5:0/286218557 >> 172.21.15.5:0/286218557 conn(0x7fef200b0cb0 msgr2=0x7fef200b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 -- 172.21.15.5:0/286218557 shutdown_connections 2023-11-24T07:58:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.872+0000 7fef26816640 1 -- 172.21.15.5:0/286218557 wait complete. 2023-11-24T07:58:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 Processor -- start 2023-11-24T07:58:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- start start 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cdfb0 0x7fef20154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef2015a710 0x7fef200ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2015da90 con 0x7fef200cc460 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2015d1f0 con 0x7fef200cdfb0 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2015d4d0 con 0x7fef2015a710 2023-11-24T07:58:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56002/0 (socket says 172.21.15.5:56002) 2023-11-24T07:58:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 -- 172.21.15.5:0/385977079 learned_addr learned my addr 172.21.15.5:0/385977079 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef24db3640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef2015a710 0x7fef200ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1f7fe640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cdfb0 0x7fef20154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 -- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef2015a710 msgr2=0x7fef200ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef2015a710 0x7fef200ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 -- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cdfb0 msgr2=0x7fef20154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cdfb0 0x7fef20154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 -- 172.21.15.5:0/385977079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18009a70 con 0x7fef200cc460 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1ffff640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c500 tx=0x7fef1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10005220 con 0x7fef200cc460 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10005380 con 0x7fef200cc460 2023-11-24T07:58:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10007270 con 0x7fef200cc460 2023-11-24T07:58:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2015d7b0 con 0x7fef200cc460 2023-11-24T07:58:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.876+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2014f940 con 0x7fef200cc460 2023-11-24T07:58:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef200671f0 con 0x7fef200cc460 2023-11-24T07:58:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef100073d0 con 0x7fef200cc460 2023-11-24T07:58:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef1cff9640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 0x7fef0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef10083330 con 0x7fef200cc460 2023-11-24T07:58:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef1f7fe640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 0x7fef0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.880+0000 7fef1f7fe640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 0x7fef0c068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef2015b9d0 tx=0x7fef14007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:14.884+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef10050b70 con 0x7fef200cc460 2023-11-24T07:58:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.040+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fef2006b460 con 0x7fef0c066470 2023-11-24T07:58:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.040+0000 7fef1cff9640 1 -- 172.21.15.5:0/385977079 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef2006b460 con 0x7fef0c066470 2023-11-24T07:58:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 msgr2=0x7fef0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 0x7fef0c068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef2015b9d0 tx=0x7fef14007d40 comp rx=0 tx=0).stop 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 msgr2=0x7fef2014f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c500 tx=0x7fef1000c9c0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 shutdown_connections 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fef0c066470 0x7fef0c068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef2015a710 0x7fef200ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef200cdfb0 0x7fef20154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 --2- 172.21.15.5:0/385977079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef200cc460 0x7fef2014f400 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 >> 172.21.15.5:0/385977079 conn(0x7fef200b0cb0 msgr2=0x7fef200ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 shutdown_connections 2023-11-24T07:58:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.044+0000 7fef26816640 1 -- 172.21.15.5:0/385977079 wait complete. 2023-11-24T07:58:15.067 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T07:58:15.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:15.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 Processor -- start 2023-11-24T07:58:15.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 -- start start 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bc015df70 0x7f9bc015e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc0072950 con 0x7f9bc0159f00 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc006e2b0 con 0x7f9bc00ae680 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bc5006640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc00cc130 con 0x7f9bc015df70 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bc0159f00 0x7f9bc00cba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59728/0 (socket says 172.21.15.5:59728) 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbed9d640 1 -- 172.21.15.5:0/3308945799 learned_addr learned my addr 172.21.15.5:0/3308945799 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbf59e640 1 --2- 172.21.15.5:0/3308945799 >> v2:172.21.15.5:3300/0 conn(0x7f9bc015df70 0x7f9bc015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbf59e640 1 -- 172.21.15.5:0/3308945799 >> v1:172.21.15.102:6789/0 conn(0x7f9bc00ae680 legacy=0x7f9bc015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbf59e640 1 -- 172.21.15.5:0/3308945799 >> v1:172.21.15.5:6789/0 conn(0x7f9bc0159f00 legacy=0x7f9bc00cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbf59e640 1 -- 172.21.15.5:0/3308945799 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc006c6f0 con 0x7f9bc015df70 2023-11-24T07:58:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.212+0000 7f9bbe59c640 1 -- 172.21.15.5:0/3308945799 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388469091 0 0) 0x7f9bc0072950 con 0x7f9bc0159f00 2023-11-24T07:58:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bbf59e640 1 --2- 172.21.15.5:0/3308945799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc015e400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009d90 tx=0x7f9bb801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d743e48bf7b2508 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bbe59c640 1 -- 172.21.15.5:0/3308945799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80a59e0 con 0x7f9bc015df70 2023-11-24T07:58:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bbe59c640 1 -- 172.21.15.5:0/3308945799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb80a5b40 con 0x7f9bc015df70 2023-11-24T07:58:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bbe59c640 1 -- 172.21.15.5:0/3308945799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80ad440 con 0x7f9bc015df70 2023-11-24T07:58:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 -- 172.21.15.5:0/3308945799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 msgr2=0x7f9bc015e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 --2- 172.21.15.5:0/3308945799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc015e400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009d90 tx=0x7f9bb801c920 comp rx=0 tx=0).stop 2023-11-24T07:58:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 -- 172.21.15.5:0/3308945799 shutdown_connections 2023-11-24T07:58:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 --2- 172.21.15.5:0/3308945799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc015e400 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 -- 172.21.15.5:0/3308945799 >> 172.21.15.5:0/3308945799 conn(0x7f9bc00b0cb0 msgr2=0x7f9bc00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 -- 172.21.15.5:0/3308945799 shutdown_connections 2023-11-24T07:58:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.216+0000 7f9bc5006640 1 -- 172.21.15.5:0/3308945799 wait complete. 2023-11-24T07:58:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 Processor -- start 2023-11-24T07:58:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 -- start start 2023-11-24T07:58:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc00ae680 0x7f9bc0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bc0159f00 0x7f9bc0154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0157500 con 0x7f9bc015df70 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc015cad0 con 0x7f9bc00ae680 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bc5006640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc015cdb0 con 0x7f9bc0159f00 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56016/0 (socket says 172.21.15.5:56016) 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 -- 172.21.15.5:0/671047177 learned_addr learned my addr 172.21.15.5:0/671047177 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bb7fff640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bc0159f00 0x7f9bc0154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbed9d640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc00ae680 0x7f9bc0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 -- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bc0159f00 msgr2=0x7f9bc0154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bc0159f00 0x7f9bc0154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 -- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc00ae680 msgr2=0x7f9bc0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9bc00ae680 0x7f9bc0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8009a70 con 0x7f9bc015df70 2023-11-24T07:58:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.220+0000 7f9bbf59e640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc014dd00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80b0040 tx=0x7f9bb80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80ade40 con 0x7f9bc015df70 2023-11-24T07:58:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb80b9450 con 0x7f9bc015df70 2023-11-24T07:58:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80b9800 con 0x7f9bc015df70 2023-11-24T07:58:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc015d090 con 0x7f9bc015df70 2023-11-24T07:58:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc014eb90 con 0x7f9bc015df70 2023-11-24T07:58:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bc006cc70 con 0x7f9bc015df70 2023-11-24T07:58:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.224+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bb80b9960 con 0x7f9bc015df70 2023-11-24T07:58:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9ba0066470 0x7f9ba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bb811f320 con 0x7f9bc015df70 2023-11-24T07:58:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f9ba006c2d0 0x7f9ba006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ba006eda0 con 0x7f9ba006c2d0 2023-11-24T07:58:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb8121900 con 0x7f9bc015df70 2023-11-24T07:58:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bbed9d640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9ba0066470 0x7f9ba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb7fff640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f9ba006c2d0 0x7f9ba006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb7fff640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f9ba006c2d0 0x7f9ba006e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bbed9d640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9ba0066470 0x7f9ba0068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000f70 tx=0x7f9bb0007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.228+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== osd.2 v2:172.21.15.5:6800/3596801206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9ba006eda0 con 0x7f9ba006c2d0 2023-11-24T07:58:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.240+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 --> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9bc00671f0 con 0x7f9ba006c2d0 2023-11-24T07:58:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bb77fe640 1 -- 172.21.15.5:0/671047177 <== osd.2 v2:172.21.15.5:6800/3596801206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9bc00671f0 con 0x7f9ba006c2d0 2023-11-24T07:58:15.246 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:15.246 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f9ba006c2d0 msgr2=0x7f9ba006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:6800/3596801206,v1:172.21.15.5:6801/3596801206] conn(0x7f9ba006c2d0 0x7f9ba006e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9ba0066470 msgr2=0x7f9ba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9ba0066470 0x7f9ba0068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000f70 tx=0x7f9bb0007240 comp rx=0 tx=0).stop 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 msgr2=0x7f9bc014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 --2- 172.21.15.5:0/671047177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc015df70 0x7f9bc014dd00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80b0040 tx=0x7f9bb80196c0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bbf59e640 1 -- 172.21.15.5:0/671047177 reap_dead start 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 shutdown_connections 2023-11-24T07:58:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 >> 172.21.15.5:0/671047177 conn(0x7f9bc00b0cb0 msgr2=0x7f9bc00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 shutdown_connections 2023-11-24T07:58:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.244+0000 7f9bc5006640 1 -- 172.21.15.5:0/671047177 wait complete. 2023-11-24T07:58:15.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T07:58:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 Processor -- start 2023-11-24T07:58:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 -- start start 2023-11-24T07:58:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef0415e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef040acd70 0x7fef040ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040af630 con 0x7fef040ad710 2023-11-24T07:58:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040acb10 con 0x7fef040acd70 2023-11-24T07:58:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.404+0000 7fef0a9a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040adba0 con 0x7fef040b5830 2023-11-24T07:58:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef03fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef0415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef040acd70 0x7fef040ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef03fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef0415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:49828/0 (socket says 172.21.15.5:49828) 2023-11-24T07:58:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 --2- 172.21.15.5:0/2522230697 >> v2:172.21.15.102:3300/0 conn(0x7fef040acd70 0x7fef040ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.5:57124/0 (socket says 172.21.15.5:57124) 2023-11-24T07:58:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef03fff640 1 -- 172.21.15.5:0/2522230697 learned_addr learned my addr 172.21.15.5:0/2522230697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef08f3e640 1 --1- 172.21.15.5:0/2522230697 >> v1:172.21.15.102:6789/0 conn(0x7fef040ad710 0x7fef04161200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.5:36184/0 (socket says 172.21.15.5:36184) 2023-11-24T07:58:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 -- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 msgr2=0x7fef0415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 --2- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef0415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 -- 172.21.15.5:0/2522230697 >> v1:172.21.15.102:6789/0 conn(0x7fef040ad710 legacy=0x7fef04161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 -- 172.21.15.5:0/2522230697 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef040ae5b0 con 0x7fef040acd70 2023-11-24T07:58:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef02ffd640 1 -- 172.21.15.5:0/2522230697 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187164399 0 0) 0x7feefc0014a0 con 0x7fef040ad710 2023-11-24T07:58:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef037fe640 1 --2- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040acd70 0x7fef040ad1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feef80097c0 tx=0x7feef801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6591b12f69ca36a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef02ffd640 1 -- 172.21.15.5:0/2522230697 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80ac600 con 0x7fef040acd70 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef02ffd640 1 -- 172.21.15.5:0/2522230697 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef80a8050 con 0x7fef040acd70 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.408+0000 7fef02ffd640 1 -- 172.21.15.5:0/2522230697 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80ac980 con 0x7fef040acd70 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040acd70 msgr2=0x7fef040ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040acd70 0x7fef040ad1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feef80097c0 tx=0x7feef801c480 comp rx=0 tx=0).stop 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- 172.21.15.5:0/2522230697 shutdown_connections 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040acd70 0x7fef040ad1d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/2522230697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef0415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- 172.21.15.5:0/2522230697 >> 172.21.15.5:0/2522230697 conn(0x7fef04071d80 msgr2=0x7fef0406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- 172.21.15.5:0/2522230697 shutdown_connections 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- 172.21.15.5:0/2522230697 wait complete. 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 Processor -- start 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- start start 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040ad710 0x7fef04153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef04154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04158a00 con 0x7fef040acd70 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef040cdb00 con 0x7fef040ad710 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef0a9a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040cdde0 con 0x7fef040b5830 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef03fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef03fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56018/0 (socket says 172.21.15.5:56018) 2023-11-24T07:58:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.412+0000 7fef03fff640 1 -- 172.21.15.5:0/311878378 learned_addr learned my addr 172.21.15.5:0/311878378 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef037fe640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040ad710 0x7fef04153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef08f3e640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef04154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 -- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 msgr2=0x7fef04154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef04154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 -- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040ad710 msgr2=0x7fef04153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040ad710 0x7fef04153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 -- 172.21.15.5:0/311878378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009420 con 0x7fef040acd70 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef03fff640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feef400e890 tx=0x7feef400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4009620 con 0x7fef040acd70 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef400c940 con 0x7fef040acd70 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef040ce0c0 con 0x7fef040acd70 2023-11-24T07:58:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400ccf0 con 0x7fef040acd70 2023-11-24T07:58:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef041529d0 con 0x7fef040acd70 2023-11-24T07:58:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef04158b70 con 0x7fef040acd70 2023-11-24T07:58:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.416+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feef4013470 con 0x7fef040acd70 2023-11-24T07:58:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.420+0000 7fef00ff9640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 0x7feef0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.420+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feef4083cf0 con 0x7fef040acd70 2023-11-24T07:58:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.420+0000 7fef037fe640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 0x7feef0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.420+0000 7fef037fe640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 0x7feef0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feef80ae000 tx=0x7feef80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.424+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef04158b70 con 0x7fef040acd70 2023-11-24T07:58:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.580+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fef040b5c10 con 0x7feef0066470 2023-11-24T07:58:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.580+0000 7fef00ff9640 1 -- 172.21.15.5:0/311878378 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feef8006e20 con 0x7feef0066470 2023-11-24T07:58:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T07:58:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 msgr2=0x7feef0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 0x7feef0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feef80ae000 tx=0x7feef80a7000 comp rx=0 tx=0).stop 2023-11-24T07:58:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 msgr2=0x7fef04152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feef400e890 tx=0x7feef400ed50 comp rx=0 tx=0).stop 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 shutdown_connections 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feef0066470 0x7feef0068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef040b5830 0x7fef04154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef040ad710 0x7fef04153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 --2- 172.21.15.5:0/311878378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef040acd70 0x7fef04152490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 >> 172.21.15.5:0/311878378 conn(0x7fef04071d80 msgr2=0x7fef040b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 shutdown_connections 2023-11-24T07:58:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.584+0000 7fef0a9a1640 1 -- 172.21.15.5:0/311878378 wait complete. 2023-11-24T07:58:15.606 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T07:58:15.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 Processor -- start 2023-11-24T07:58:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 -- start start 2023-11-24T07:58:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b6415d2a0 0x7f1b640d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b640b5350 0x7f1b640d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640b6250 con 0x7f1b640d2c20 2023-11-24T07:58:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640ce8c0 con 0x7f1b640b5350 2023-11-24T07:58:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6359e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b64161cf0 con 0x7f1b6415d2a0 2023-11-24T07:58:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b640b5350 0x7f1b640d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b640b5350 0x7f1b640d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56022/0 (socket says 172.21.15.5:56022) 2023-11-24T07:58:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 -- 172.21.15.5:0/1603131010 learned_addr learned my addr 172.21.15.5:0/1603131010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b6259c640 1 --2- 172.21.15.5:0/1603131010 >> v2:172.21.15.102:3300/0 conn(0x7f1b6415d2a0 0x7f1b640d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 -- 172.21.15.5:0/1603131010 >> v2:172.21.15.102:3300/0 conn(0x7f1b6415d2a0 msgr2=0x7f1b640d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1603131010 >> v2:172.21.15.102:3300/0 conn(0x7f1b6415d2a0 0x7f1b640d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 -- 172.21.15.5:0/1603131010 >> v1:172.21.15.102:6789/0 conn(0x7f1b640d2c20 legacy=0x7f1b640b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.752+0000 7f1b62d9d640 1 -- 172.21.15.5:0/1603131010 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64161170 con 0x7f1b640b5350 2023-11-24T07:58:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1603131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640d10e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1b640cdb60 tx=0x7f1b5c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257405c5329ffd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6159a640 1 -- 172.21.15.5:0/1603131010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5860 con 0x7f1b640b5350 2023-11-24T07:58:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6159a640 1 -- 172.21.15.5:0/1603131010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0a59c0 con 0x7f1b640b5350 2023-11-24T07:58:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6159a640 1 -- 172.21.15.5:0/1603131010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5d50 con 0x7f1b640b5350 2023-11-24T07:58:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 -- 172.21.15.5:0/1603131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 msgr2=0x7f1b640d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1603131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640d10e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1b640cdb60 tx=0x7f1b5c01c9a0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 -- 172.21.15.5:0/1603131010 shutdown_connections 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1603131010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640d10e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1603131010 >> v2:172.21.15.102:3300/0 conn(0x7f1b6415d2a0 0x7f1b640d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 -- 172.21.15.5:0/1603131010 >> 172.21.15.5:0/1603131010 conn(0x7f1b640668a0 msgr2=0x7f1b640cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 -- 172.21.15.5:0/1603131010 shutdown_connections 2023-11-24T07:58:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.756+0000 7f1b6359e640 1 -- 172.21.15.5:0/1603131010 wait complete. 2023-11-24T07:58:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 Processor -- start 2023-11-24T07:58:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- start start 2023-11-24T07:58:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b640d2c20 0x7f1b640ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6415d2a0 0x7f1b640c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ca3c0 con 0x7f1b640b5350 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ca6a0 con 0x7f1b640d2c20 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ca980 con 0x7f1b6415d2a0 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56038/0 (socket says 172.21.15.5:56038) 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 -- 172.21.15.5:0/1714265561 learned_addr learned my addr 172.21.15.5:0/1714265561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6415d2a0 0x7f1b640c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b61d9b640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b640d2c20 0x7f1b640ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 -- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6415d2a0 msgr2=0x7f1b640c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6415d2a0 0x7f1b640c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 -- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b640d2c20 msgr2=0x7f1b640ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b640d2c20 0x7f1b640ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009b30 con 0x7f1b640b5350 2023-11-24T07:58:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6415d2a0 0x7f1b640c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6259c640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640cb460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e870 tx=0x7f1b5400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54009510 con 0x7f1b640b5350 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400eec0 con 0x7f1b640b5350 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640cac60 con 0x7f1b640b5350 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400cb40 con 0x7f1b640b5350 2023-11-24T07:58:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640cd0f0 con 0x7f1b640b5350 2023-11-24T07:58:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.760+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b64160e20 con 0x7f1b640b5350 2023-11-24T07:58:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b5400cca0 con 0x7f1b640b5350 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1b44066470 0x7f1b44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b54084090 con 0x7f1b640b5350 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f1b4406c2d0 0x7f1b4406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b4406eda0 con 0x7f1b4406c2d0 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b54084400 con 0x7f1b640b5350 2023-11-24T07:58:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b61d9b640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1b44066470 0x7f1b44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f1b4406c2d0 0x7f1b4406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b62d9d640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f1b4406c2d0 0x7f1b4406e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b61d9b640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1b44066470 0x7f1b44068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415bf80 tx=0x7f1b58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.764+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== osd.3 v2:172.21.15.5:6824/4161007531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1b4406eda0 con 0x7f1b4406c2d0 2023-11-24T07:58:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 --> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b6415d680 con 0x7f1b4406c2d0 2023-11-24T07:58:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b52ffd640 1 -- 172.21.15.5:0/1714265561 <== osd.3 v2:172.21.15.5:6824/4161007531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1b5c009510 con 0x7f1b4406c2d0 2023-11-24T07:58:15.783 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:15.783 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f1b4406c2d0 msgr2=0x7f1b4406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:6824/4161007531,v1:172.21.15.5:6825/4161007531] conn(0x7f1b4406c2d0 0x7f1b4406e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1b44066470 msgr2=0x7f1b44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f1b44066470 0x7f1b44068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415bf80 tx=0x7f1b58009040 comp rx=0 tx=0).stop 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 msgr2=0x7f1b640cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 --2- 172.21.15.5:0/1714265561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b640b5350 0x7f1b640cb460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e870 tx=0x7f1b5400ec70 comp rx=0 tx=0).stop 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b62d9d640 1 -- 172.21.15.5:0/1714265561 reap_dead start 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 shutdown_connections 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 >> 172.21.15.5:0/1714265561 conn(0x7f1b640668a0 msgr2=0x7f1b640c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 shutdown_connections 2023-11-24T07:58:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.780+0000 7f1b6359e640 1 -- 172.21.15.5:0/1714265561 wait complete. 2023-11-24T07:58:15.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T07:58:15.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.940+0000 7fd34845a640 1 Processor -- start 2023-11-24T07:58:15.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.940+0000 7fd34845a640 1 -- start start 2023-11-24T07:58:15.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd34845a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd3400abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd34845a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400b2710 con 0x7fd34015a710 2023-11-24T07:58:15.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd34845a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400b29f0 con 0x7fd3400cbd50 2023-11-24T07:58:15.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd34845a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400cca80 con 0x7fd3400cdfb0 2023-11-24T07:58:15.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3459f5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd34015a710 0x7fd3400ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59730/0 (socket says 172.21.15.5:59730) 2023-11-24T07:58:15.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3459f5640 1 -- 172.21.15.5:0/3417712609 learned_addr learned my addr 172.21.15.5:0/3417712609 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3461f6640 1 --2- 172.21.15.5:0/3417712609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd3400abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214577193 0 0) 0x7fd3400b2710 con 0x7fd34015a710 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c005740 con 0x7fd34015a710 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133471599 0 0) 0x7fd3400b29f0 con 0x7fd3400cbd50 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3400b2710 con 0x7fd3400cbd50 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2310701492 0 0) 0x7fd32c005740 con 0x7fd34015a710 2023-11-24T07:58:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3461f6640 1 -- 172.21.15.5:0/3417712609 >> v1:172.21.15.102:6789/0 conn(0x7fd3400cbd50 legacy=0x7fd3400cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3461f6640 1 -- 172.21.15.5:0/3417712609 >> v1:172.21.15.5:6789/0 conn(0x7fd34015a710 legacy=0x7fd3400ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.944+0000 7fd3461f6640 1 -- 172.21.15.5:0/3417712609 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400b2cd0 con 0x7fd3400cdfb0 2023-11-24T07:58:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd3461f6640 1 --2- 172.21.15.5:0/3417712609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd3400abf90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0097f0 tx=0x7fd33c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6052a23620e630a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330001680 con 0x7fd3400cdfb0 2023-11-24T07:58:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c0a7050 con 0x7fd3400cdfb0 2023-11-24T07:58:15.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd3451f4640 1 -- 172.21.15.5:0/3417712609 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c004250 con 0x7fd3400cdfb0 2023-11-24T07:58:15.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 -- 172.21.15.5:0/3417712609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 msgr2=0x7fd3400abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 --2- 172.21.15.5:0/3417712609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd3400abf90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0097f0 tx=0x7fd33c01c3b0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 -- 172.21.15.5:0/3417712609 shutdown_connections 2023-11-24T07:58:15.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 --2- 172.21.15.5:0/3417712609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd3400abf90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 -- 172.21.15.5:0/3417712609 >> 172.21.15.5:0/3417712609 conn(0x7fd3400b0cb0 msgr2=0x7fd3400b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:15.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 -- 172.21.15.5:0/3417712609 shutdown_connections 2023-11-24T07:58:15.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 -- 172.21.15.5:0/3417712609 wait complete. 2023-11-24T07:58:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.948+0000 7fd34845a640 1 Processor -- start 2023-11-24T07:58:15.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- start start 2023-11-24T07:58:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd34015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 0x7fd34015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3401f9f00 con 0x7fd3400cbd50 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015da90 con 0x7fd34015a710 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3401f9660 con 0x7fd3400cdfb0 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56040/0 (socket says 172.21.15.5:56040) 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3469f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 0x7fd34015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 -- 172.21.15.5:0/1105950028 learned_addr learned my addr 172.21.15.5:0/1105950028 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:15.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3459f5640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd34015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 -- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 msgr2=0x7fd34015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd34015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 -- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 msgr2=0x7fd34015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 0x7fd34015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 -- 172.21.15.5:0/1105950028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009420 con 0x7fd3400cbd50 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3469f7640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 0x7fd34015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd3461f6640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ae040 tx=0x7fd33c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c003e60 con 0x7fd3400cbd50 2023-11-24T07:58:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c006e20 con 0x7fd3400cbd50 2023-11-24T07:58:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3401f9940 con 0x7fd3400cbd50 2023-11-24T07:58:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0ab6a0 con 0x7fd3400cbd50 2023-11-24T07:58:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd340163e30 con 0x7fd3400cbd50 2023-11-24T07:58:15.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.952+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3400671f0 con 0x7fd3400cbd50 2023-11-24T07:58:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.956+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd33c0b2040 con 0x7fd3400cbd50 2023-11-24T07:58:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.956+0000 7fd336ffd640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.956+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd33c11e070 con 0x7fd3400cbd50 2023-11-24T07:58:15.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.956+0000 7fd3459f5640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:15.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.956+0000 7fd3459f5640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 0x7fd324068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd3401661a0 tx=0x7fd3300016e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:15.960+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd33c14f280 con 0x7fd3400cbd50 2023-11-24T07:58:16.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.116+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3400ccea0 con 0x7fd324066470 2023-11-24T07:58:16.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.116+0000 7fd336ffd640 1 -- 172.21.15.5:0/1105950028 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd33000f8e0 con 0x7fd324066470 2023-11-24T07:58:16.122 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T07:58:16.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 msgr2=0x7fd324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 0x7fd324068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd3401661a0 tx=0x7fd3300016e0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 msgr2=0x7fd3401f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ae040 tx=0x7fd33c019150 comp rx=0 tx=0).stop 2023-11-24T07:58:16.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 shutdown_connections 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd34015a710 0x7fd34015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3400cdfb0 0x7fd34015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 --2- 172.21.15.5:0/1105950028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3400cbd50 0x7fd3401f8ff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 >> 172.21.15.5:0/1105950028 conn(0x7fd3400b0cb0 msgr2=0x7fd3400b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 shutdown_connections 2023-11-24T07:58:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.120+0000 7fd34845a640 1 -- 172.21.15.5:0/1105950028 wait complete. 2023-11-24T07:58:16.143 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T07:58:16.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:16.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.288+0000 7fb8f5879640 1 Processor -- start 2023-11-24T07:58:16.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.288+0000 7fb8f5879640 1 -- start start 2023-11-24T07:58:16.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8f5879640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f00b43a0 0x7fb8f00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8f5879640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8f0070470 0x7fb8f00708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8f5879640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f00726d0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8f5879640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f00b4d60 con 0x7fb8f0070470 2023-11-24T07:58:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8f5879640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f015c100 con 0x7fb8f00b43a0 2023-11-24T07:58:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8f0070470 0x7fb8f00708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8f0070470 0x7fb8f00708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56042/0 (socket says 172.21.15.5:56042) 2023-11-24T07:58:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/374900958 learned_addr learned my addr 172.21.15.5:0/374900958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:16.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8e7fff640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f00b43a0 0x7fb8f00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/374900958 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f00b43a0 msgr2=0x7fb8f00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f00b43a0 0x7fb8f00b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/374900958 >> v1:172.21.15.102:6789/0 conn(0x7fb8f0158cc0 legacy=0x7fb8f0071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.292+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/374900958 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f01590a0 con 0x7fb8f0070470 2023-11-24T07:58:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ef7fe640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0070470 0x7fb8f00708a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009e50 tx=0x7fb8e801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1d7a9a4a44ede4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ee7fc640 1 -- 172.21.15.5:0/374900958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80a58a0 con 0x7fb8f0070470 2023-11-24T07:58:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ee7fc640 1 -- 172.21.15.5:0/374900958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80a5a00 con 0x7fb8f0070470 2023-11-24T07:58:16.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ee7fc640 1 -- 172.21.15.5:0/374900958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80a5d90 con 0x7fb8f0070470 2023-11-24T07:58:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- 172.21.15.5:0/374900958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0070470 msgr2=0x7fb8f00708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0070470 0x7fb8f00708a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009e50 tx=0x7fb8e801c9e0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- 172.21.15.5:0/374900958 shutdown_connections 2023-11-24T07:58:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f00b43a0 0x7fb8f00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- 172.21.15.5:0/374900958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0070470 0x7fb8f00708a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- 172.21.15.5:0/374900958 >> 172.21.15.5:0/374900958 conn(0x7fb8f00b0d90 msgr2=0x7fb8f00b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- 172.21.15.5:0/374900958 shutdown_connections 2023-11-24T07:58:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- 172.21.15.5:0/374900958 wait complete. 2023-11-24T07:58:16.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 Processor -- start 2023-11-24T07:58:16.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- start start 2023-11-24T07:58:16.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f0070470 0x7fb8f01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f00b43a0 0x7fb8f013c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 0x7fb8f013d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0150670 con 0x7fb8f0158cc0 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0150390 con 0x7fb8f00b43a0 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8f5879640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0159400 con 0x7fb8f0070470 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 0x7fb8f013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 0x7fb8f013d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56056/0 (socket says 172.21.15.5:56056) 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.296+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/3398053810 learned_addr learned my addr 172.21.15.5:0/3398053810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8e7fff640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f00b43a0 0x7fb8f013c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f0070470 msgr2=0x7fb8f01400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8eeffd640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f0070470 0x7fb8f01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f0070470 0x7fb8f01400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f00b43a0 msgr2=0x7fb8f013c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f00b43a0 0x7fb8f013c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009b30 con 0x7fb8f0158cc0 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8e7fff640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f00b43a0 0x7fb8f013c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8eeffd640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f0070470 0x7fb8f01400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ef7fe640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 0x7fb8f013d250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80af040 tx=0x7fb8e8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80b8670 con 0x7fb8f0158cc0 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80b87f0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80b8ba0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f00cd790 con 0x7fb8f0158cc0 2023-11-24T07:58:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f01599c0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8f00cd610 con 0x7fb8f0158cc0 2023-11-24T07:58:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8e80b8d00 con 0x7fb8f0158cc0 2023-11-24T07:58:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb8d0066470 0x7fb8d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.300+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8e811f2c0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8ecff9640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7fb8d006c2d0 0x7fb8d006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8d006eda0 con 0x7fb8d006c2d0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e81218a0 con 0x7fb8f0158cc0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8eeffd640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb8d0066470 0x7fb8d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8e7fff640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7fb8d006c2d0 0x7fb8d006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8eeffd640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb8d0066470 0x7fb8d0068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0165fe0 tx=0x7fb8e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8e7fff640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7fb8d006c2d0 0x7fb8d006e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.304+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== osd.4 v2:172.21.15.102:6800/401703187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb8d006eda0 con 0x7fb8d006c2d0 2023-11-24T07:58:16.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.316+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 --> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8f015c570 con 0x7fb8d006c2d0 2023-11-24T07:58:16.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.316+0000 7fb8ecff9640 1 -- 172.21.15.5:0/3398053810 <== osd.4 v2:172.21.15.102:6800/401703187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb8d8009c10 con 0x7fb8d006c2d0 2023-11-24T07:58:16.322 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:16.322 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7fb8d006c2d0 msgr2=0x7fb8d006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6800/401703187,v1:172.21.15.102:6801/401703187] conn(0x7fb8d006c2d0 0x7fb8d006e6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb8d0066470 msgr2=0x7fb8d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb8d0066470 0x7fb8d0068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0165fe0 tx=0x7fb8e0009040 comp rx=0 tx=0).stop 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 msgr2=0x7fb8f013d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 --2- 172.21.15.5:0/3398053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8f0158cc0 0x7fb8f013d250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80af040 tx=0x7fb8e8019780 comp rx=0 tx=0).stop 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8ef7fe640 1 -- 172.21.15.5:0/3398053810 reap_dead start 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 shutdown_connections 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 >> 172.21.15.5:0/3398053810 conn(0x7fb8f00b0d90 msgr2=0x7fb8f015eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 shutdown_connections 2023-11-24T07:58:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.320+0000 7fb8f5879640 1 -- 172.21.15.5:0/3398053810 wait complete. 2023-11-24T07:58:16.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T07:58:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 Processor -- start 2023-11-24T07:58:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 -- start start 2023-11-24T07:58:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 0x7f81f006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81f00cbd90 0x7f81f015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f0159630 con 0x7f81f00ce5d0 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f015bba0 con 0x7f81f00cbd90 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.480+0000 7f81f87d1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00cdd50 con 0x7f81f00cb9b0 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81f00cbd90 0x7f81f015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81f00cbd90 0x7f81f015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56062/0 (socket says 172.21.15.5:56062) 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 -- 172.21.15.5:0/1297376648 learned_addr learned my addr 172.21.15.5:0/1297376648 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f656d640 1 --2- 172.21.15.5:0/1297376648 >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 0x7f81f006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 -- 172.21.15.5:0/1297376648 >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 msgr2=0x7f81f006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 --2- 172.21.15.5:0/1297376648 >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 0x7f81f006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 -- 172.21.15.5:0/1297376648 >> v1:172.21.15.102:6789/0 conn(0x7f81f00ce5d0 legacy=0x7f81f015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 -- 172.21.15.5:0/1297376648 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f015f6d0 con 0x7f81f00cbd90 2023-11-24T07:58:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f656d640 1 --2- 172.21.15.5:0/1297376648 >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 0x7f81f006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f5d6c640 1 --2- 172.21.15.5:0/1297376648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00cbd90 0x7f81f015f190 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f81f006c360 tx=0x7f81e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88f449d0989ed11 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f556b640 1 -- 172.21.15.5:0/1297376648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00aa430 con 0x7f81f00cbd90 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f556b640 1 -- 172.21.15.5:0/1297376648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00aa590 con 0x7f81f00cbd90 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.484+0000 7f81f556b640 1 -- 172.21.15.5:0/1297376648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00aa920 con 0x7f81f00cbd90 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- 172.21.15.5:0/1297376648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00cbd90 msgr2=0x7f81f015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- 172.21.15.5:0/1297376648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00cbd90 0x7f81f015f190 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f81f006c360 tx=0x7f81e001c4d0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- 172.21.15.5:0/1297376648 shutdown_connections 2023-11-24T07:58:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- 172.21.15.5:0/1297376648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00cbd90 0x7f81f015f190 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- 172.21.15.5:0/1297376648 >> v2:172.21.15.102:3300/0 conn(0x7f81f00cb9b0 0x7f81f006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- 172.21.15.5:0/1297376648 >> 172.21.15.5:0/1297376648 conn(0x7f81f00b0cb0 msgr2=0x7f81f00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- 172.21.15.5:0/1297376648 shutdown_connections 2023-11-24T07:58:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- 172.21.15.5:0/1297376648 wait complete. 2023-11-24T07:58:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 Processor -- start 2023-11-24T07:58:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- start start 2023-11-24T07:58:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f00cb9b0 0x7f81f015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 0x7f81f00ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01568b0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f015e8f0 con 0x7f81f00cb9b0 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f87d1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0156b00 con 0x7f81f00cbd90 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f6d6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f6d6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56078/0 (socket says 172.21.15.5:56078) 2023-11-24T07:58:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f6d6e640 1 -- 172.21.15.5:0/3311157153 learned_addr learned my addr 172.21.15.5:0/3311157153 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f656d640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f00cb9b0 0x7f81f015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f5d6c640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 0x7f81f00ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f6d6e640 1 -- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 msgr2=0x7f81f00ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.488+0000 7f81f6d6e640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 0x7f81f00ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f6d6e640 1 -- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f00cb9b0 msgr2=0x7f81f015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f6d6e640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f00cb9b0 0x7f81f015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f6d6e640 1 -- 172.21.15.5:0/3311157153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00094d0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f5d6c640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 0x7f81f00ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f6d6e640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f81e800c730 tx=0x7f81e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8003b80 con 0x7f81f00ce5d0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8003ce0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e800aa30 con 0x7f81f00ce5d0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f0156de0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01570c0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00671f0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81e800ab90 con 0x7f81f00ce5d0 2023-11-24T07:58:16.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 0x7f81d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.492+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81e80837d0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.496+0000 7f81f656d640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 0x7f81d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.496+0000 7f81f656d640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 0x7f81d4068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006e90 tx=0x7f81ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.500+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81e8050fe0 con 0x7f81f00ce5d0 2023-11-24T07:58:16.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f015caf0 con 0x7f81d40664a0 2023-11-24T07:58:16.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81e6ffd640 1 -- 172.21.15.5:0/3311157153 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81ec0118e0 con 0x7f81d40664a0 2023-11-24T07:58:16.664 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 msgr2=0x7f81d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 0x7f81d4068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006e90 tx=0x7f81ec008040 comp rx=0 tx=0).stop 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 msgr2=0x7f81f0155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f81e800c730 tx=0x7f81e800cbf0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 shutdown_connections 2023-11-24T07:58:16.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f81d40664a0 0x7f81d4068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81f00ce5d0 0x7f81f0155350 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f00cbd90 0x7f81f00ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 --2- 172.21.15.5:0/3311157153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f00cb9b0 0x7f81f015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 >> 172.21.15.5:0/3311157153 conn(0x7f81f00b0cb0 msgr2=0x7f81f00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 shutdown_connections 2023-11-24T07:58:16.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.660+0000 7f81f87d1640 1 -- 172.21.15.5:0/3311157153 wait complete. 2023-11-24T07:58:16.685 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T07:58:16.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 Processor -- start 2023-11-24T07:58:16.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 -- start start 2023-11-24T07:58:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb86806e120 0x7fb86815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb86815e4d0 0x7fb8680ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8680cd870 con 0x7fb868154940 2023-11-24T07:58:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb868154d20 con 0x7fb86815e4d0 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb86daea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86815ecc0 con 0x7fb86806e120 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb8677fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb868154940 0x7fb86806da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59740/0 (socket says 172.21.15.5:59740) 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb8677fe640 1 -- 172.21.15.5:0/2605918610 learned_addr learned my addr 172.21.15.5:0/2605918610 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb867fff640 1 --2- 172.21.15.5:0/2605918610 >> v2:172.21.15.5:3300/0 conn(0x7fb86815e4d0 0x7fb8680ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb866ffd640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb86806e120 0x7fb86815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb8667fc640 1 -- 172.21.15.5:0/2605918610 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512889373 0 0) 0x7fb8680cd870 con 0x7fb868154940 2023-11-24T07:58:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb8667fc640 1 -- 172.21.15.5:0/2605918610 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850003530 con 0x7fb868154940 2023-11-24T07:58:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb867fff640 1 -- 172.21.15.5:0/2605918610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb86806e120 msgr2=0x7fb86815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb867fff640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb86806e120 0x7fb86815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb867fff640 1 -- 172.21.15.5:0/2605918610 >> v1:172.21.15.5:6789/0 conn(0x7fb868154940 legacy=0x7fb86806da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.828+0000 7fb867fff640 1 -- 172.21.15.5:0/2605918610 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680ccf40 con 0x7fb86815e4d0 2023-11-24T07:58:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb867fff640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86815e4d0 0x7fb8680ad080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb860009d90 tx=0x7fb86001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4105924d257afa8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb8667fc640 1 -- 172.21.15.5:0/2605918610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600a5710 con 0x7fb86815e4d0 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb8667fc640 1 -- 172.21.15.5:0/2605918610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600a5870 con 0x7fb86815e4d0 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb8667fc640 1 -- 172.21.15.5:0/2605918610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600a5c00 con 0x7fb86815e4d0 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 -- 172.21.15.5:0/2605918610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86815e4d0 msgr2=0x7fb8680ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86815e4d0 0x7fb8680ad080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb860009d90 tx=0x7fb86001c740 comp rx=0 tx=0).stop 2023-11-24T07:58:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 -- 172.21.15.5:0/2605918610 shutdown_connections 2023-11-24T07:58:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86815e4d0 0x7fb8680ad080 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 --2- 172.21.15.5:0/2605918610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb86806e120 0x7fb86815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 -- 172.21.15.5:0/2605918610 >> 172.21.15.5:0/2605918610 conn(0x7fb8680b0cb0 msgr2=0x7fb8680b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 -- 172.21.15.5:0/2605918610 shutdown_connections 2023-11-24T07:58:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.832+0000 7fb86daea640 1 -- 172.21.15.5:0/2605918610 wait complete. 2023-11-24T07:58:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 Processor -- start 2023-11-24T07:58:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- start start 2023-11-24T07:58:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 0x7fb86814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb868154940 0x7fb868153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb86815e4d0 0x7fb86814e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868151720 con 0x7fb86806e120 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868153700 con 0x7fb86815e4d0 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb868138670 con 0x7fb868154940 2023-11-24T07:58:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 0x7fb86814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 0x7fb86814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56096/0 (socket says 172.21.15.5:56096) 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 -- 172.21.15.5:0/2551141654 learned_addr learned my addr 172.21.15.5:0/2551141654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 -- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb868154940 msgr2=0x7fb868153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb868154940 0x7fb868153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 -- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb86815e4d0 msgr2=0x7fb86814e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb86815e4d0 0x7fb86814e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860009a70 con 0x7fb86806e120 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb8677fe640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 0x7fb86814b4e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c4d0 tx=0x7fb85800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858005cf0 con 0x7fb86806e120 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858005e50 con 0x7fb86806e120 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858007270 con 0x7fb86806e120 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb868152ae0 con 0x7fb86806e120 2023-11-24T07:58:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb868153040 con 0x7fb86806e120 2023-11-24T07:58:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.836+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb86814f930 con 0x7fb86806e120 2023-11-24T07:58:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8580073d0 con 0x7fb86806e120 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb854066470 0x7fb854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8580830e0 con 0x7fb86806e120 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7fb85406c2d0 0x7fb85406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb85406eda0 con 0x7fb85406c2d0 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb858085600 con 0x7fb86806e120 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb866ffd640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb854066470 0x7fb854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb867fff640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7fb85406c2d0 0x7fb85406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb866ffd640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb854066470 0x7fb854068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006aa0 tx=0x7fb85c006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb867fff640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7fb85406c2d0 0x7fb85406e6f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.840+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== osd.5 v2:172.21.15.102:6808/2731741621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb85406eda0 con 0x7fb85406c2d0 2023-11-24T07:58:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 --> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8680cdce0 con 0x7fb85406c2d0 2023-11-24T07:58:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb84ffff640 1 -- 172.21.15.5:0/2551141654 <== osd.5 v2:172.21.15.102:6808/2731741621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb8600a56d0 con 0x7fb85406c2d0 2023-11-24T07:58:16.859 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:16.860 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7fb85406c2d0 msgr2=0x7fb85406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6808/2731741621,v1:172.21.15.102:6810/2731741621] conn(0x7fb85406c2d0 0x7fb85406e6f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb854066470 msgr2=0x7fb854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb854066470 0x7fb854068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006aa0 tx=0x7fb85c006a30 comp rx=0 tx=0).stop 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 msgr2=0x7fb86814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 --2- 172.21.15.5:0/2551141654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb86806e120 0x7fb86814b4e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c4d0 tx=0x7fb85800c990 comp rx=0 tx=0).stop 2023-11-24T07:58:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb867fff640 1 -- 172.21.15.5:0/2551141654 reap_dead start 2023-11-24T07:58:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 shutdown_connections 2023-11-24T07:58:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 >> 172.21.15.5:0/2551141654 conn(0x7fb8680b0cb0 msgr2=0x7fb8680ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 shutdown_connections 2023-11-24T07:58:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:16.856+0000 7fb86daea640 1 -- 172.21.15.5:0/2551141654 wait complete. 2023-11-24T07:58:16.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T07:58:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.016+0000 7fb5c61df640 1 Processor -- start 2023-11-24T07:58:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.016+0000 7fb5c61df640 1 -- start start 2023-11-24T07:58:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5c61df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 0x7fb5c006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5c61df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5c00cbd90 0x7fb5c015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5c61df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c0159630 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5c61df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c015bba0 con 0x7fb5c00cbd90 2023-11-24T07:58:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5c61df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00cdd50 con 0x7fb5c00cb9b0 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5bf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 0x7fb5c006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5beffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5c00cbd90 0x7fb5c015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5bf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 0x7fb5c006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.5:49910/0 (socket says 172.21.15.5:49910) 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5bf7fe640 1 -- 172.21.15.5:0/1771105651 learned_addr learned my addr 172.21.15.5:0/1771105651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5beffd640 1 -- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 msgr2=0x7fb5c006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5beffd640 1 --2- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 0x7fb5c006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5beffd640 1 -- 172.21.15.5:0/1771105651 >> v1:172.21.15.102:6789/0 conn(0x7fb5c00ce5d0 legacy=0x7fb5c015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.020+0000 7fb5beffd640 1 -- 172.21.15.5:0/1771105651 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c015f6d0 con 0x7fb5c00cbd90 2023-11-24T07:58:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5beffd640 1 --2- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cbd90 0x7fb5c015f190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097c0 tx=0x7fb5b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2bcd7b62cfc3752 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5be7fc640 1 -- 172.21.15.5:0/1771105651 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40ab650 con 0x7fb5c00cbd90 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5be7fc640 1 -- 172.21.15.5:0/1771105651 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b40ab7b0 con 0x7fb5c00cbd90 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5be7fc640 1 -- 172.21.15.5:0/1771105651 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40abb40 con 0x7fb5c00cbd90 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cbd90 msgr2=0x7fb5c015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cbd90 0x7fb5c015f190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097c0 tx=0x7fb5b401c450 comp rx=0 tx=0).stop 2023-11-24T07:58:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- 172.21.15.5:0/1771105651 shutdown_connections 2023-11-24T07:58:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cbd90 0x7fb5c015f190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- 172.21.15.5:0/1771105651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cb9b0 0x7fb5c006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- 172.21.15.5:0/1771105651 >> 172.21.15.5:0/1771105651 conn(0x7fb5c00b0cb0 msgr2=0x7fb5c00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- 172.21.15.5:0/1771105651 shutdown_connections 2023-11-24T07:58:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- 172.21.15.5:0/1771105651 wait complete. 2023-11-24T07:58:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 Processor -- start 2023-11-24T07:58:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- start start 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cb9b0 0x7fb5c015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cbd90 0x7fb5c015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0155e60 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00aeb20 con 0x7fb5c00cb9b0 2023-11-24T07:58:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.024+0000 7fb5c61df640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00aee00 con 0x7fb5c00cbd90 2023-11-24T07:58:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56098/0 (socket says 172.21.15.5:56098) 2023-11-24T07:58:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5beffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cbd90 0x7fb5c015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 -- 172.21.15.5:0/2668097861 learned_addr learned my addr 172.21.15.5:0/2668097861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bf7fe640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cb9b0 0x7fb5c015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 -- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cbd90 msgr2=0x7fb5c015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cbd90 0x7fb5c015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 -- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cb9b0 msgr2=0x7fb5c015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cb9b0 0x7fb5c015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 -- 172.21.15.5:0/2668097861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009420 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5bffff640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c730 tx=0x7fb5b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8003b80 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b8003ce0 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800aa30 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c00af0e0 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c00ad3e0 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00671f0 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.028+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5b800ab90 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.032+0000 7fb5a7fff640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 0x7fb5ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.032+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5b8083800 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.032+0000 7fb5bf7fe640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 0x7fb5ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.032+0000 7fb5bf7fe640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 0x7fb5ac068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00cb560 tx=0x7fb5b0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.036+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5b8051020 con 0x7fb5c00ce5d0 2023-11-24T07:58:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.188+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c015caf0 con 0x7fb5ac066470 2023-11-24T07:58:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5a7fff640 1 -- 172.21.15.5:0/2668097861 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5b0011a60 con 0x7fb5ac066470 2023-11-24T07:58:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T07:58:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 msgr2=0x7fb5ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 0x7fb5ac068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00cb560 tx=0x7fb5b0009240 comp rx=0 tx=0).stop 2023-11-24T07:58:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 msgr2=0x7fb5c015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c730 tx=0x7fb5b800cbf0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 shutdown_connections 2023-11-24T07:58:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb5ac066470 0x7fb5ac068930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c00ce5d0 0x7fb5c015e290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c00cbd90 0x7fb5c015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 --2- 172.21.15.5:0/2668097861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c00cb9b0 0x7fb5c015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 >> 172.21.15.5:0/2668097861 conn(0x7fb5c00b0cb0 msgr2=0x7fb5c006e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 shutdown_connections 2023-11-24T07:58:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.192+0000 7fb5c61df640 1 -- 172.21.15.5:0/2668097861 wait complete. 2023-11-24T07:58:17.215 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T07:58:17.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 Processor -- start 2023-11-24T07:58:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 -- start start 2023-11-24T07:58:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 0x7feec40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feec40ae680 0x7feec40cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 0x7feec415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4072950 con 0x7feec40ae680 2023-11-24T07:58:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec406e2b0 con 0x7feec40cd920 2023-11-24T07:58:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feeca957640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec406c6f0 con 0x7feec4159f00 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.360+0000 7feec37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feec40ae680 0x7feec40cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feec40ae680 0x7feec40cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36092/0 (socket says 172.21.15.5:36092) 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 -- 172.21.15.5:0/472394519 learned_addr learned my addr 172.21.15.5:0/472394519 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec3fff640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 0x7feec40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec8ef4640 1 --2- 172.21.15.5:0/472394519 >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 0x7feec415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 -- 172.21.15.5:0/472394519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 msgr2=0x7feec40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 0x7feec40ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 -- 172.21.15.5:0/472394519 >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 msgr2=0x7feec415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 --2- 172.21.15.5:0/472394519 >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 0x7feec415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 -- 172.21.15.5:0/472394519 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec406e550 con 0x7feec40ae680 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec3fff640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 0x7feec40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec8ef4640 1 --2- 172.21.15.5:0/472394519 >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 0x7feec415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec37fe640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40cd3e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feec415d7c0 tx=0x7feeb801d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76d7bec8c12a134 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec2ffd640 1 -- 172.21.15.5:0/472394519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80a67b0 con 0x7feec40ae680 2023-11-24T07:58:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec2ffd640 1 -- 172.21.15.5:0/472394519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80a6910 con 0x7feec40ae680 2023-11-24T07:58:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.364+0000 7feec2ffd640 1 -- 172.21.15.5:0/472394519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80a6ca0 con 0x7feec40ae680 2023-11-24T07:58:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- 172.21.15.5:0/472394519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 msgr2=0x7feec40cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40cd3e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feec415d7c0 tx=0x7feeb801d8d0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- 172.21.15.5:0/472394519 shutdown_connections 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- 172.21.15.5:0/472394519 >> v2:172.21.15.102:3300/0 conn(0x7feec40cd920 0x7feec415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40cd3e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- 172.21.15.5:0/472394519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec4159f00 0x7feec40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- 172.21.15.5:0/472394519 >> 172.21.15.5:0/472394519 conn(0x7feec40b0cb0 msgr2=0x7feec40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- 172.21.15.5:0/472394519 shutdown_connections 2023-11-24T07:58:17.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- 172.21.15.5:0/472394519 wait complete. 2023-11-24T07:58:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 Processor -- start 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- start start 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec40cd920 0x7feec414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec40b1da0 0x7feec41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b26a0 con 0x7feec40ae680 2023-11-24T07:58:17.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b2980 con 0x7feec40b1da0 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feeca957640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b2c60 con 0x7feec40cd920 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36100/0 (socket says 172.21.15.5:36100) 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 -- 172.21.15.5:0/2279286216 learned_addr learned my addr 172.21.15.5:0/2279286216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec37fe640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec40cd920 0x7feec414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec8ef4640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec40b1da0 0x7feec41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 -- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec40cd920 msgr2=0x7feec414eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feec40cd920 0x7feec414eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 -- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec40b1da0 msgr2=0x7feec41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec40b1da0 0x7feec41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.368+0000 7feec3fff640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb800a670 con 0x7feec40ae680 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec3fff640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40b3740 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c7f0 tx=0x7feeb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4007820 con 0x7feec40ae680 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4007980 con 0x7feec40ae680 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40b2f40 con 0x7feec40ae680 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4007d30 con 0x7feec40ae680 2023-11-24T07:58:17.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40b2230 con 0x7feec40ae680 2023-11-24T07:58:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feec40b2af0 con 0x7feec40ae680 2023-11-24T07:58:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feeb40113f0 con 0x7feec40ae680 2023-11-24T07:58:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb00664a0 0x7feeb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feeb4083e40 con 0x7feec40ae680 2023-11-24T07:58:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7feeb006c300 0x7feeb006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feeb006edd0 con 0x7feeb006c300 2023-11-24T07:58:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb4086420 con 0x7feec40ae680 2023-11-24T07:58:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec37fe640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb00664a0 0x7feeb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.372+0000 7feec8ef4640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7feeb006c300 0x7feeb006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.376+0000 7feec37fe640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb00664a0 0x7feeb0068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feeb80b0000 tx=0x7feeb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.376+0000 7feec8ef4640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7feeb006c300 0x7feeb006e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.376+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== osd.6 v2:172.21.15.102:6809/2249940910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feeb006edd0 con 0x7feeb006c300 2023-11-24T07:58:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 --> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feec40b2480 con 0x7feeb006c300 2023-11-24T07:58:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feec0ff9640 1 -- 172.21.15.5:0/2279286216 <== osd.6 v2:172.21.15.102:6809/2249940910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feebc00d590 con 0x7feeb006c300 2023-11-24T07:58:17.393 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:17.394 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:17.394 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7feeb006c300 msgr2=0x7feeb006e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6809/2249940910,v1:172.21.15.102:6811/2249940910] conn(0x7feeb006c300 0x7feeb006e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb00664a0 msgr2=0x7feeb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7feeb00664a0 0x7feeb0068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feeb80b0000 tx=0x7feeb8008040 comp rx=0 tx=0).stop 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 msgr2=0x7feec40b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 --2- 172.21.15.5:0/2279286216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feec40ae680 0x7feec40b3740 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c7f0 tx=0x7feeb400ccb0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feec8ef4640 1 -- 172.21.15.5:0/2279286216 reap_dead start 2023-11-24T07:58:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 shutdown_connections 2023-11-24T07:58:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.388+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 >> 172.21.15.5:0/2279286216 conn(0x7feec40b0cb0 msgr2=0x7feec4156540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.392+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 shutdown_connections 2023-11-24T07:58:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.392+0000 7feeca957640 1 -- 172.21.15.5:0/2279286216 wait complete. 2023-11-24T07:58:17.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T07:58:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 Processor -- start 2023-11-24T07:58:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 -- start start 2023-11-24T07:58:17.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f672c15d8f0 0x7f672c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c15ecc0 con 0x7f672c0d0510 2023-11-24T07:58:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0cdfb0 con 0x7f672c0ced30 2023-11-24T07:58:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6733679640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0d4420 con 0x7f672c15d8f0 2023-11-24T07:58:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731c16640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f672c0d0510 0x7f672c0d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47298/0 (socket says 172.21.15.5:47298) 2023-11-24T07:58:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731c16640 1 -- 172.21.15.5:0/3118441321 learned_addr learned my addr 172.21.15.5:0/3118441321 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731415640 1 --2- 172.21.15.5:0/3118441321 >> v2:172.21.15.102:3300/0 conn(0x7f672c15d8f0 0x7f672c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6723fff640 1 -- 172.21.15.5:0/3118441321 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315588788 0 0) 0x7f672c15ecc0 con 0x7f672c0d0510 2023-11-24T07:58:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6723fff640 1 -- 172.21.15.5:0/3118441321 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6718003530 con 0x7f672c0d0510 2023-11-24T07:58:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731415640 1 -- 172.21.15.5:0/3118441321 >> v1:172.21.15.102:6789/0 conn(0x7f672c0ced30 legacy=0x7f672c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731415640 1 -- 172.21.15.5:0/3118441321 >> v1:172.21.15.5:6789/0 conn(0x7f672c0d0510 legacy=0x7f672c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.552+0000 7f6731415640 1 -- 172.21.15.5:0/3118441321 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0d4140 con 0x7f672c15d8f0 2023-11-24T07:58:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6731415640 1 --2- 172.21.15.5:0/3118441321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c15d8f0 0x7f672c15e780 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f67280097f0 tx=0x7f672801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2884c7fba8f15db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6723fff640 1 -- 172.21.15.5:0/3118441321 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280ab650 con 0x7f672c15d8f0 2023-11-24T07:58:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6723fff640 1 -- 172.21.15.5:0/3118441321 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280ab7b0 con 0x7f672c15d8f0 2023-11-24T07:58:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6723fff640 1 -- 172.21.15.5:0/3118441321 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280abb40 con 0x7f672c15d8f0 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 -- 172.21.15.5:0/3118441321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c15d8f0 msgr2=0x7f672c15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 --2- 172.21.15.5:0/3118441321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c15d8f0 0x7f672c15e780 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f67280097f0 tx=0x7f672801c450 comp rx=0 tx=0).stop 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 -- 172.21.15.5:0/3118441321 shutdown_connections 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 --2- 172.21.15.5:0/3118441321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c15d8f0 0x7f672c15e780 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 -- 172.21.15.5:0/3118441321 >> 172.21.15.5:0/3118441321 conn(0x7f672c09c750 msgr2=0x7f672c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 -- 172.21.15.5:0/3118441321 shutdown_connections 2023-11-24T07:58:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.556+0000 7f6733679640 1 -- 172.21.15.5:0/3118441321 wait complete. 2023-11-24T07:58:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 Processor -- start 2023-11-24T07:58:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 -- start start 2023-11-24T07:58:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c0ced30 0x7f672c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f672c15d8f0 0x7f672c153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0b7780 con 0x7f672c0d0510 2023-11-24T07:58:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15be90 con 0x7f672c0ced30 2023-11-24T07:58:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15b350 con 0x7f672c15d8f0 2023-11-24T07:58:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36114/0 (socket says 172.21.15.5:36114) 2023-11-24T07:58:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 -- 172.21.15.5:0/3841529335 learned_addr learned my addr 172.21.15.5:0/3841529335 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 -- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f672c15d8f0 msgr2=0x7f672c153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f672c15d8f0 0x7f672c153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 -- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c0ced30 msgr2=0x7f672c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6731415640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c0ced30 0x7f672c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c0ced30 0x7f672c15cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 -- 172.21.15.5:0/3841529335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009420 con 0x7f672c0d0510 2023-11-24T07:58:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6730c14640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c3c0 tx=0x7f671c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0052d0 con 0x7f672c0d0510 2023-11-24T07:58:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c005430 con 0x7f672c0d0510 2023-11-24T07:58:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c15b5f0 con 0x7f672c0d0510 2023-11-24T07:58:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.560+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c003840 con 0x7f672c0d0510 2023-11-24T07:58:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c15bbb0 con 0x7f672c0d0510 2023-11-24T07:58:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c04e850 con 0x7f672c0d0510 2023-11-24T07:58:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f671c0039a0 con 0x7f672c0d0510 2023-11-24T07:58:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6721ffb640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 0x7f6710068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f671c083030 con 0x7f672c0d0510 2023-11-24T07:58:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.564+0000 7f6731415640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 0x7f6710068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.568+0000 7f6731415640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 0x7f6710068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f67280af000 tx=0x7f6728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.568+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f671c050840 con 0x7f672c0d0510 2023-11-24T07:58:17.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f672c0b29b0 con 0x7f6710066470 2023-11-24T07:58:17.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6721ffb640 1 -- 172.21.15.5:0/3841529335 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f67280bc090 con 0x7f6710066470 2023-11-24T07:58:17.731 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T07:58:17.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 msgr2=0x7f6710068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 0x7f6710068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f67280af000 tx=0x7f6728008040 comp rx=0 tx=0).stop 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 msgr2=0x7f672c15ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c3c0 tx=0x7f671c00c880 comp rx=0 tx=0).stop 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 shutdown_connections 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f6710066470 0x7f6710068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f672c15d8f0 0x7f672c153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f672c0d0510 0x7f672c15ae10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 --2- 172.21.15.5:0/3841529335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f672c0ced30 0x7f672c15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 >> 172.21.15.5:0/3841529335 conn(0x7f672c09c750 msgr2=0x7f672c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 shutdown_connections 2023-11-24T07:58:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.728+0000 7f6733679640 1 -- 172.21.15.5:0/3841529335 wait complete. 2023-11-24T07:58:17.753 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T07:58:17.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T07:58:17.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 Processor -- start 2023-11-24T07:58:17.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 -- start start 2023-11-24T07:58:17.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e1415a710 0x7f9e140abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e140cbd50 0x7f9e140cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140b2710 con 0x7f9e140cdfb0 2023-11-24T07:58:17.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140cca80 con 0x7f9e140cbd50 2023-11-24T07:58:17.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e19491640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140b29f0 con 0x7f9e1415a710 2023-11-24T07:58:17.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e140cbd50 0x7f9e140cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e140cbd50 0x7f9e140cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36124/0 (socket says 172.21.15.5:36124) 2023-11-24T07:58:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e137fe640 1 -- 172.21.15.5:0/1140772661 learned_addr learned my addr 172.21.15.5:0/1140772661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.896+0000 7f9e0bfff640 1 --2- 172.21.15.5:0/1140772661 >> v2:172.21.15.102:3300/0 conn(0x7f9e1415a710 0x7f9e140abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e137fe640 1 -- 172.21.15.5:0/1140772661 >> v2:172.21.15.102:3300/0 conn(0x7f9e1415a710 msgr2=0x7f9e140abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1140772661 >> v2:172.21.15.102:3300/0 conn(0x7f9e1415a710 0x7f9e140abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e137fe640 1 -- 172.21.15.5:0/1140772661 >> v1:172.21.15.102:6789/0 conn(0x7f9e140cdfb0 legacy=0x7f9e140ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e137fe640 1 -- 172.21.15.5:0/1140772661 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140b2cd0 con 0x7f9e140cbd50 2023-11-24T07:58:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1140772661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cbd50 0x7f9e140cc1e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9e140d0040 tx=0x7f9e0c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1c2d2e61479e3e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e127fc640 1 -- 172.21.15.5:0/1140772661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0a5880 con 0x7f9e140cbd50 2023-11-24T07:58:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e127fc640 1 -- 172.21.15.5:0/1140772661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0a59e0 con 0x7f9e140cbd50 2023-11-24T07:58:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.900+0000 7f9e127fc640 1 -- 172.21.15.5:0/1140772661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0a5d70 con 0x7f9e140cbd50 2023-11-24T07:58:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- 172.21.15.5:0/1140772661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cbd50 msgr2=0x7f9e140cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- 172.21.15.5:0/1140772661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cbd50 0x7f9e140cc1e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9e140d0040 tx=0x7f9e0c01c9a0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- 172.21.15.5:0/1140772661 shutdown_connections 2023-11-24T07:58:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- 172.21.15.5:0/1140772661 >> v2:172.21.15.102:3300/0 conn(0x7f9e1415a710 0x7f9e140abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- 172.21.15.5:0/1140772661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cbd50 0x7f9e140cc1e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- 172.21.15.5:0/1140772661 >> 172.21.15.5:0/1140772661 conn(0x7f9e140b0cb0 msgr2=0x7f9e140b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- 172.21.15.5:0/1140772661 shutdown_connections 2023-11-24T07:58:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- 172.21.15.5:0/1140772661 wait complete. 2023-11-24T07:58:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 Processor -- start 2023-11-24T07:58:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- start start 2023-11-24T07:58:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e140cbd50 0x7f9e14099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 0x7f9e14154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e1415a710 0x7f9e1415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14155ed0 con 0x7f9e140cdfb0 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14156770 con 0x7f9e1415a710 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e19491640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14155500 con 0x7f9e140cbd50 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 0x7f9e14154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 0x7f9e14154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36132/0 (socket says 172.21.15.5:36132) 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 -- 172.21.15.5:0/1716643559 learned_addr learned my addr 172.21.15.5:0/1716643559 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e1415a710 0x7f9e1415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e12ffd640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e140cbd50 0x7f9e14099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 -- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e140cbd50 msgr2=0x7f9e14099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e140cbd50 0x7f9e14099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 -- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e1415a710 msgr2=0x7f9e1415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e1415a710 0x7f9e1415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c009b30 con 0x7f9e140cdfb0 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e1415a710 0x7f9e1415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.904+0000 7f9e0bfff640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 0x7f9e14154fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00e870 tx=0x7f9dfc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc009510 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00eec0 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00cb80 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1409ce10 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e14156400 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e1406b460 con 0x7f9e140cdfb0 2023-11-24T07:58:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dfc00cce0 con 0x7f9e140cdfb0 2023-11-24T07:58:17.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9df4066470 0x7f9df4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9dfc083ca0 con 0x7f9e140cdfb0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f9df406c2d0 0x7f9df406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9df406eda0 con 0x7f9df406c2d0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dfc086360 con 0x7f9e140cdfb0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e12ffd640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9df4066470 0x7f9df4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.908+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f9df406c2d0 0x7f9df406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.912+0000 7f9e12ffd640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9df4066470 0x7f9df4068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000f70 tx=0x7f9e04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.912+0000 7f9e137fe640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f9df406c2d0 0x7f9df406e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:17.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.912+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== osd.7 v2:172.21.15.102:6824/1162611146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9df406eda0 con 0x7f9df406c2d0 2023-11-24T07:58:17.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 --> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e140671f0 con 0x7f9df406c2d0 2023-11-24T07:58:17.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e0b7fe640 1 -- 172.21.15.5:0/1716643559 <== osd.7 v2:172.21.15.102:6824/1162611146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9e140671f0 con 0x7f9df406c2d0 2023-11-24T07:58:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-24T07:58:17.929 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T07:58:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-24T07:58:17.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f9df406c2d0 msgr2=0x7f9df406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6824/1162611146,v1:172.21.15.102:6825/1162611146] conn(0x7f9df406c2d0 0x7f9df406e6f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:17.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9df4066470 msgr2=0x7f9df4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f9df4066470 0x7f9df4068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000f70 tx=0x7f9e04009040 comp rx=0 tx=0).stop 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 msgr2=0x7f9e14154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 --2- 172.21.15.5:0/1716643559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e140cdfb0 0x7f9e14154fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00e870 tx=0x7f9dfc00ec70 comp rx=0 tx=0).stop 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e137fe640 1 -- 172.21.15.5:0/1716643559 reap_dead start 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 shutdown_connections 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 >> 172.21.15.5:0/1716643559 conn(0x7f9e140b0cb0 msgr2=0x7f9e140ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 shutdown_connections 2023-11-24T07:58:17.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:17.924+0000 7f9e19491640 1 -- 172.21.15.5:0/1716643559 wait complete. 2023-11-24T07:58:17.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T07:58:18.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 Processor -- start 2023-11-24T07:58:18.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 -- start start 2023-11-24T07:58:18.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0e14159f00 0x7f0e140cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e14164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e14072950 con 0x7f0e140ae680 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1406e2b0 con 0x7f0e14159f00 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1c49a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1406c6f0 con 0x7f0e140cd5b0 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e19a35640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e140ae680 0x7f0e140ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47306/0 (socket says 172.21.15.5:47306) 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e19a35640 1 -- 172.21.15.5:0/2392394857 learned_addr learned my addr 172.21.15.5:0/2392394857 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2392394857 >> v2:172.21.15.102:3300/0 conn(0x7f0e14159f00 0x7f0e140cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.088+0000 7f0e1aa37640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e14164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e19234640 1 -- 172.21.15.5:0/2392394857 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120460558 0 0) 0x7f0e14072950 con 0x7f0e140ae680 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e19234640 1 -- 172.21.15.5:0/2392394857 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e00003530 con 0x7f0e140ae680 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1a236640 1 -- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 msgr2=0x7f0e14164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e14164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1a236640 1 -- 172.21.15.5:0/2392394857 >> v1:172.21.15.5:6789/0 conn(0x7f0e140ae680 legacy=0x7f0e140ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1a236640 1 -- 172.21.15.5:0/2392394857 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1406e550 con 0x7f0e14159f00 2023-11-24T07:58:18.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1aa37640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e14164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T07:58:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e14159f00 0x7f0e140cba20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097c0 tx=0x7f0e1001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9b9727575545be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e19234640 1 -- 172.21.15.5:0/2392394857 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100ab650 con 0x7f0e14159f00 2023-11-24T07:58:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e19234640 1 -- 172.21.15.5:0/2392394857 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e100ab7b0 con 0x7f0e14159f00 2023-11-24T07:58:18.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.092+0000 7f0e19234640 1 -- 172.21.15.5:0/2392394857 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100abb40 con 0x7f0e14159f00 2023-11-24T07:58:18.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e14159f00 msgr2=0x7f0e140cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e14159f00 0x7f0e140cba20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097c0 tx=0x7f0e1001c450 comp rx=0 tx=0).stop 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2392394857 shutdown_connections 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e14164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2392394857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e14159f00 0x7f0e140cba20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2392394857 >> 172.21.15.5:0/2392394857 conn(0x7f0e140b0cb0 msgr2=0x7f0e140b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2392394857 shutdown_connections 2023-11-24T07:58:18.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2392394857 wait complete. 2023-11-24T07:58:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 Processor -- start 2023-11-24T07:58:18.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- start start 2023-11-24T07:58:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 0x7f0e140c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e1415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141f6240 con 0x7f0e14159f00 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141f64c0 con 0x7f0e140ae680 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1c49a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141f67a0 con 0x7f0e140cd5b0 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36144/0 (socket says 172.21.15.5:36144) 2023-11-24T07:58:18.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 -- 172.21.15.5:0/2545137975 learned_addr learned my addr 172.21.15.5:0/2545137975 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e19a35640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e1415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 0x7f0e140c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 -- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 msgr2=0x7f0e1415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e1415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 -- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 msgr2=0x7f0e140c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 0x7f0e140c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1aa37640 1 -- 172.21.15.5:0/2545137975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c009a70 con 0x7f0e14159f00 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e19a35640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e1415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.096+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 0x7f0e140c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e1aa37640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00efc0 tx=0x7f0e0c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c009d70 con 0x7f0e14159f00 2023-11-24T07:58:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c00f040 con 0x7f0e14159f00 2023-11-24T07:58:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0039a0 con 0x7f0e14159f00 2023-11-24T07:58:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e10009420 con 0x7f0e14159f00 2023-11-24T07:58:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141f6d60 con 0x7f0e14159f00 2023-11-24T07:58:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e140671f0 con 0x7f0e14159f00 2023-11-24T07:58:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e0c0144a0 con 0x7f0e14159f00 2023-11-24T07:58:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 0x7f0df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0e0c084880 con 0x7f0e14159f00 2023-11-24T07:58:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.100+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 0x7f0df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.104+0000 7f0e1a236640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 0x7f0df8068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0e100af000 tx=0x7f0e10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.104+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e0c052000 con 0x7f0e14159f00 2023-11-24T07:58:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.264+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e14070890 con 0x7f0df8066470 2023-11-24T07:58:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.264+0000 7f0e0affd640 1 -- 172.21.15.5:0/2545137975 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e100bc090 con 0x7f0df8066470 2023-11-24T07:58:18.268 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T07:58:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 msgr2=0x7f0df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 0x7f0df8068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0e100af000 tx=0x7f0e10008040 comp rx=0 tx=0).stop 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 msgr2=0x7f0e14151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00efc0 tx=0x7f0e0c009f90 comp rx=0 tx=0).stop 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 shutdown_connections 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f0df8066470 0x7f0df8068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e14159f00 0x7f0e14151420 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e140cd5b0 0x7f0e1415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 --2- 172.21.15.5:0/2545137975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e140ae680 0x7f0e140c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 >> 172.21.15.5:0/2545137975 conn(0x7f0e140b0cb0 msgr2=0x7f0e140b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 shutdown_connections 2023-11-24T07:58:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.268+0000 7f0e1c49a640 1 -- 172.21.15.5:0/2545137975 wait complete. 2023-11-24T07:58:18.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:58:18.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 Processor -- start 2023-11-24T07:58:18.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 -- start start 2023-11-24T07:58:18.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec78144c80 0x7fec780abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fec780ac460 0x7fec780706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec78145060 con 0x7fec78070c20 2023-11-24T07:58:18.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec78071fd0 con 0x7fec780ac460 2023-11-24T07:58:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7f0c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780ac8c0 con 0x7fec78144c80 2023-11-24T07:58:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7d666640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec78070c20 0x7fec7815eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47316/0 (socket says 172.21.15.5:47316) 2023-11-24T07:58:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec7d666640 1 -- 172.21.15.5:0/2823709873 learned_addr learned my addr 172.21.15.5:0/2823709873 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:18.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.428+0000 7fec77fff640 1 --2- 172.21.15.5:0/2823709873 >> v2:172.21.15.102:3300/0 conn(0x7fec780ac460 0x7fec780706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec7ce65640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec78144c80 0x7fec780abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec777fe640 1 -- 172.21.15.5:0/2823709873 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368240000 0 0) 0x7fec78145060 con 0x7fec78070c20 2023-11-24T07:58:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec777fe640 1 -- 172.21.15.5:0/2823709873 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec68003530 con 0x7fec78070c20 2023-11-24T07:58:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec77fff640 1 -- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec78144c80 msgr2=0x7fec780abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec77fff640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec78144c80 0x7fec780abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec77fff640 1 -- 172.21.15.5:0/2823709873 >> v1:172.21.15.5:6789/0 conn(0x7fec78070c20 legacy=0x7fec7815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec77fff640 1 -- 172.21.15.5:0/2823709873 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78071450 con 0x7fec780ac460 2023-11-24T07:58:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec77fff640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec780ac460 0x7fec780706e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f903d5bc717f0f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec777fe640 1 -- 172.21.15.5:0/2823709873 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640ab650 con 0x7fec780ac460 2023-11-24T07:58:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec777fe640 1 -- 172.21.15.5:0/2823709873 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec640ab7b0 con 0x7fec780ac460 2023-11-24T07:58:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.432+0000 7fec777fe640 1 -- 172.21.15.5:0/2823709873 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640abb40 con 0x7fec780ac460 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec780ac460 msgr2=0x7fec780706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec780ac460 0x7fec780706e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401c450 comp rx=0 tx=0).stop 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- 172.21.15.5:0/2823709873 shutdown_connections 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec780ac460 0x7fec780706e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/2823709873 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec78144c80 0x7fec780abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- 172.21.15.5:0/2823709873 >> 172.21.15.5:0/2823709873 conn(0x7fec780b0c40 msgr2=0x7fec780b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- 172.21.15.5:0/2823709873 shutdown_connections 2023-11-24T07:58:18.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- 172.21.15.5:0/2823709873 wait complete. 2023-11-24T07:58:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 Processor -- start 2023-11-24T07:58:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- start start 2023-11-24T07:58:18.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 0x7fec7813aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec780ac460 0x7fec7814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780b2600 con 0x7fec78144c80 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815ae50 con 0x7fec78070c20 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7f0c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780b1d30 con 0x7fec780ac460 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7d666640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7d666640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36146/0 (socket says 172.21.15.5:36146) 2023-11-24T07:58:18.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.436+0000 7fec7d666640 1 -- 172.21.15.5:0/84571189 learned_addr learned my addr 172.21.15.5:0/84571189 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:18.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec77fff640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec780ac460 0x7fec7814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7ce65640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 0x7fec7813aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 -- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec780ac460 msgr2=0x7fec7814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec780ac460 0x7fec7814d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 -- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 msgr2=0x7fec7813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 0x7fec7813aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 -- 172.21.15.5:0/84571189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009420 con 0x7fec78144c80 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7ce65640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 0x7fec7813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7d666640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fec7000cb40 tx=0x7fec7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000aca0 con 0x7fec78144c80 2023-11-24T07:58:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000ae00 con 0x7fec78144c80 2023-11-24T07:58:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec781394b0 con 0x7fec78144c80 2023-11-24T07:58:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70012620 con 0x7fec78144c80 2023-11-24T07:58:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec780b2220 con 0x7fec78144c80 2023-11-24T07:58:18.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780b1ba0 con 0x7fec78144c80 2023-11-24T07:58:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec70007070 con 0x7fec78144c80 2023-11-24T07:58:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 0x7fec5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.440+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec70083b60 con 0x7fec78144c80 2023-11-24T07:58:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.444+0000 7fec7ce65640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 0x7fec5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.444+0000 7fec7ce65640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 0x7fec5c068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009b10 tx=0x7fec6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:18.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.444+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec70051380 con 0x7fec78144c80 2023-11-24T07:58:18.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.600+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec78168210 con 0x7fec5c066470 2023-11-24T07:58:18.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.600+0000 7fec757fa640 1 -- 172.21.15.5:0/84571189 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50301 (secure 0 0 0) 0x7fec6c004030 con 0x7fec5c066470 2023-11-24T07:58:18.606 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:18.606 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:58:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 msgr2=0x7fec5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 0x7fec5c068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009b10 tx=0x7fec6c008040 comp rx=0 tx=0).stop 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 msgr2=0x7fec78165470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fec7000cb40 tx=0x7fec7000a060 comp rx=0 tx=0).stop 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 shutdown_connections 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fec5c066470 0x7fec5c068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec78144c80 0x7fec78165470 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec780ac460 0x7fec7814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 --2- 172.21.15.5:0/84571189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec78070c20 0x7fec7813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 >> 172.21.15.5:0/84571189 conn(0x7fec780b0c40 msgr2=0x7fec780afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 shutdown_connections 2023-11-24T07:58:18.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:18.604+0000 7fec7f0c9640 1 -- 172.21.15.5:0/84571189 wait complete. 2023-11-24T07:58:18.626 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-24T07:58:17.253727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237316,"kb_used_data":4504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737404,"statfs":{"total":773094113280,"available":772851101696,"internally_reserved":0,"allocated":4612096,"data_stored":2533044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001871"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T07:58:03.190365+0000","last_change":"2023-11-24T07:56:38.368106+0000","last_active":"2023-11-24T07:58:03.190365+0000","last_peered":"2023-11-24T07:58:03.190365+0000","last_clean":"2023-11-24T07:58:03.190365+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:58:03.190365+0000","last_undegraded":"2023-11-24T07:58:03.190365+0000","last_fullsized":"2023-11-24T07:58:03.190365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T07:56:37.301260+0000","last_clean_scrub_stamp":"2023-11-24T07:56:37.301260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:15.207418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.501},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.97399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.439},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.5},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.56799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.753},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.93600000000000005}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.97799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":758897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.016},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.92900000000000005}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":1.119},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.94799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:58:18.630 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T07:56:37.301260+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=7, tm_min=56, tm_sec=37, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=7, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T07:58:18.630 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T07:58:38.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T07:58:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 Processor -- start 2023-11-24T07:58:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 -- start start 2023-11-24T07:58:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb94c15d7b0 0x7fb94c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb94c0d2080 0x7fb94c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c0cefd0 con 0x7fb94c0cead0 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0cf2b0 con 0x7fb94c0d2080 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb951679640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c06b3f0 con 0x7fb94c15d7b0 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb94c0d2080 0x7fb94c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb94c0d2080 0x7fb94c06bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35914/0 (socket says 172.21.15.5:35914) 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 -- 172.21.15.5:0/2749361993 learned_addr learned my addr 172.21.15.5:0/2749361993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94affd640 1 --2- 172.21.15.5:0/2749361993 >> v2:172.21.15.102:3300/0 conn(0x7fb94c15d7b0 0x7fb94c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 -- 172.21.15.5:0/2749361993 >> v2:172.21.15.102:3300/0 conn(0x7fb94c15d7b0 msgr2=0x7fb94c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 --2- 172.21.15.5:0/2749361993 >> v2:172.21.15.102:3300/0 conn(0x7fb94c15d7b0 0x7fb94c0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 -- 172.21.15.5:0/2749361993 >> v1:172.21.15.5:6789/0 conn(0x7fb94c0cead0 legacy=0x7fb94c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.783+0000 7fb94b7fe640 1 -- 172.21.15.5:0/2749361993 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c06b6d0 con 0x7fb94c0d2080 2023-11-24T07:58:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb94b7fe640 1 --2- 172.21.15.5:0/2749361993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0d2080 0x7fb94c06bed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0d3310 tx=0x7fb94401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ce33e0a82a9d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:38.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb94a7fc640 1 -- 172.21.15.5:0/2749361993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440a5760 con 0x7fb94c0d2080 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb94a7fc640 1 -- 172.21.15.5:0/2749361993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9440a58c0 con 0x7fb94c0d2080 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb94a7fc640 1 -- 172.21.15.5:0/2749361993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440a5c50 con 0x7fb94c0d2080 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 -- 172.21.15.5:0/2749361993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0d2080 msgr2=0x7fb94c06bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 --2- 172.21.15.5:0/2749361993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0d2080 0x7fb94c06bed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0d3310 tx=0x7fb94401c880 comp rx=0 tx=0).stop 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 -- 172.21.15.5:0/2749361993 shutdown_connections 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 --2- 172.21.15.5:0/2749361993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0d2080 0x7fb94c06bed0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 --2- 172.21.15.5:0/2749361993 >> v2:172.21.15.102:3300/0 conn(0x7fb94c15d7b0 0x7fb94c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 -- 172.21.15.5:0/2749361993 >> 172.21.15.5:0/2749361993 conn(0x7fb94c0d33b0 msgr2=0x7fb94c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 -- 172.21.15.5:0/2749361993 shutdown_connections 2023-11-24T07:58:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.787+0000 7fb951679640 1 -- 172.21.15.5:0/2749361993 wait complete. 2023-11-24T07:58:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 Processor -- start 2023-11-24T07:58:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- start start 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb94c0d2080 0x7fb94c0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb94c15d7b0 0x7fb94c15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c154f40 con 0x7fb94c0cead0 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c154330 con 0x7fb94c15d7b0 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c154610 con 0x7fb94c0d2080 2023-11-24T07:58:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35920/0 (socket says 172.21.15.5:35920) 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 -- 172.21.15.5:0/515149434 learned_addr learned my addr 172.21.15.5:0/515149434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb943fff640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb94c0d2080 0x7fb94c0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94b7fe640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb94c15d7b0 0x7fb94c15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 -- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb94c0d2080 msgr2=0x7fb94c0c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb94c0d2080 0x7fb94c0c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 -- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb94c15d7b0 msgr2=0x7fb94c15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb94c15d7b0 0x7fb94c15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 -- 172.21.15.5:0/515149434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009b30 con 0x7fb94c0cead0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb94affd640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d5f0 tx=0x7fb93c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0125f0 con 0x7fb94c0cead0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c012750 con 0x7fb94c0cead0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012b00 con 0x7fb94c0cead0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c1548f0 con 0x7fb94c0cead0 2023-11-24T07:58:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.791+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c0c9c10 con 0x7fb94c0cead0 2023-11-24T07:58:38.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.795+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c04e850 con 0x7fb94c0cead0 2023-11-24T07:58:38.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.795+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb93c012c60 con 0x7fb94c0cead0 2023-11-24T07:58:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.795+0000 7fb9437fe640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 0x7fb92c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.795+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb93c083fc0 con 0x7fb94c0cead0 2023-11-24T07:58:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.795+0000 7fb943fff640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 0x7fb92c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.799+0000 7fb943fff640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 0x7fb92c068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0ce650 tx=0x7fb934009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.799+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb93c051790 con 0x7fb94c0cead0 2023-11-24T07:58:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.955+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 --> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb94c154da0 con 0x7fb92c066470 2023-11-24T07:58:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb9437fe640 1 -- 172.21.15.5:0/515149434 <== mgr.4103 v2:172.21.15.102:6832/2673346826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50259 (secure 0 0 0) 0x7fb934001450 con 0x7fb92c066470 2023-11-24T07:58:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-24T07:58:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 msgr2=0x7fb92c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 0x7fb92c068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0ce650 tx=0x7fb934009040 comp rx=0 tx=0).stop 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 msgr2=0x7fb94c0b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d5f0 tx=0x7fb93c00dab0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 shutdown_connections 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7fb92c066470 0x7fb92c068930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb94c15d7b0 0x7fb94c15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb94c0d2080 0x7fb94c0c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 --2- 172.21.15.5:0/515149434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb94c0cead0 0x7fb94c0b63a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 >> 172.21.15.5:0/515149434 conn(0x7fb94c0d33b0 msgr2=0x7fb94c0d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 shutdown_connections 2023-11-24T07:58:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:38.959+0000 7fb951679640 1 -- 172.21.15.5:0/515149434 wait complete. 2023-11-24T07:58:38.985 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-11-24T07:58:37.256959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237304,"kb_used_data":4504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737416,"statfs":{"total":773094113280,"available":772851113984,"internally_reserved":0,"allocated":4612096,"data_stored":2533044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001956"},"pg_stats":[{"pgid":"1.0","version":"37'119","reported_seq":193,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T07:58:21.400741+0000","last_change":"2023-11-24T07:58:21.400778+0000","last_active":"2023-11-24T07:58:21.400741+0000","last_peered":"2023-11-24T07:58:21.400741+0000","last_clean":"2023-11-24T07:58:21.400741+0000","last_became_active":"2023-11-24T07:56:38.366857+0000","last_became_peered":"2023-11-24T07:56:38.366857+0000","last_unstale":"2023-11-24T07:58:21.400741+0000","last_undegraded":"2023-11-24T07:58:21.400741+0000","last_fullsized":"2023-11-24T07:58:21.400741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'119","last_scrub_stamp":"2023-11-24T07:58:21.400632+0000","last_deep_scrub":"37'119","last_deep_scrub_stamp":"2023-11-24T07:58:21.400632+0000","last_clean_scrub_stamp":"2023-11-24T07:58:21.400632+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:16.938505+0000","scrub_duration":0.0070925179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":759916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.746}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.502}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.625},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":1.0469999999999999}]},{"osd":4,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Nov 24 07:57:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.622}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.434},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.751},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Nov 24 07:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.84599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":3.6850000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":7.6660000000000004,"5min":7.6660000000000004,"15min":7.6660000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.91100000000000003}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":4.0990000000000002},"last":0.88}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":168529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.628}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1019904,"data_stored":758897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79500000000000004}]},{"osd":5,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.745}]},{"osd":7,"last update":"Fri Nov 24 07:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T07:58:38.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T07:58:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 Processor -- start 2023-11-24T07:58:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 -- start start 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f89080b4c40 0x7f89080b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89080d10e0 0x7f89080d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89080b55d0 con 0x7f890815d2a0 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89080ce8c0 con 0x7f89080d10e0 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f890c92b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89080b6250 con 0x7f89080b4c40 2023-11-24T07:58:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f89077fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f890815d2a0 0x7f89080d26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36246/0 (socket says 172.21.15.5:36246) 2023-11-24T07:58:39.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f89077fe640 1 -- 172.21.15.5:0/4279223670 learned_addr learned my addr 172.21.15.5:0/4279223670 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-24T07:58:39.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.123+0000 7f8907fff640 1 --2- 172.21.15.5:0/4279223670 >> v2:172.21.15.5:3300/0 conn(0x7f89080d10e0 0x7f89080d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8906ffd640 1 --2- 172.21.15.5:0/4279223670 >> v2:172.21.15.102:3300/0 conn(0x7f89080b4c40 0x7f89080b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f89067fc640 1 -- 172.21.15.5:0/4279223670 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636228124 0 0) 0x7f88f8001120 con 0x7f890815d2a0 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f89067fc640 1 -- 172.21.15.5:0/4279223670 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f0003530 con 0x7f890815d2a0 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8907fff640 1 -- 172.21.15.5:0/4279223670 >> v2:172.21.15.102:3300/0 conn(0x7f89080b4c40 msgr2=0x7f89080b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8907fff640 1 --2- 172.21.15.5:0/4279223670 >> v2:172.21.15.102:3300/0 conn(0x7f89080b4c40 0x7f89080b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8907fff640 1 -- 172.21.15.5:0/4279223670 >> v1:172.21.15.5:6789/0 conn(0x7f890815d2a0 legacy=0x7f89080d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8907fff640 1 -- 172.21.15.5:0/4279223670 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8908161cf0 con 0x7f89080d10e0 2023-11-24T07:58:39.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f8907fff640 1 --2- 172.21.15.5:0/4279223670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080d10e0 0x7f89080d1520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f89080cd8a0 tx=0x7f890001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fef1b6df65eac4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f89067fc640 1 -- 172.21.15.5:0/4279223670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000a59a0 con 0x7f89080d10e0 2023-11-24T07:58:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f89067fc640 1 -- 172.21.15.5:0/4279223670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89000a5b00 con 0x7f89080d10e0 2023-11-24T07:58:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.127+0000 7f89067fc640 1 -- 172.21.15.5:0/4279223670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000a5e90 con 0x7f89080d10e0 2023-11-24T07:58:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- 172.21.15.5:0/4279223670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080d10e0 msgr2=0x7f89080d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- 172.21.15.5:0/4279223670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080d10e0 0x7f89080d1520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f89080cd8a0 tx=0x7f890001c8e0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- 172.21.15.5:0/4279223670 shutdown_connections 2023-11-24T07:58:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- 172.21.15.5:0/4279223670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080d10e0 0x7f89080d1520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- 172.21.15.5:0/4279223670 >> v2:172.21.15.102:3300/0 conn(0x7f89080b4c40 0x7f89080b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- 172.21.15.5:0/4279223670 >> 172.21.15.5:0/4279223670 conn(0x7f89080668a0 msgr2=0x7f89080cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- 172.21.15.5:0/4279223670 shutdown_connections 2023-11-24T07:58:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- 172.21.15.5:0/4279223670 wait complete. 2023-11-24T07:58:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 Processor -- start 2023-11-24T07:58:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- start start 2023-11-24T07:58:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 0x7f8908154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f890815d2a0 0x7f89081547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89080cc440 con 0x7f89080b4c40 2023-11-24T07:58:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8908158960 con 0x7f89080d10e0 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f890c92b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89080cbdf0 con 0x7f890815d2a0 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35952/0 (socket says 172.21.15.5:35952) 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 -- 172.21.15.5:0/1772269708 learned_addr learned my addr 172.21.15.5:0/1772269708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f8906ffd640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 0x7f8908154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f8907fff640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f890815d2a0 0x7f89081547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 -- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f890815d2a0 msgr2=0x7f89081547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f890815d2a0 0x7f89081547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 -- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 msgr2=0x7f8908154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 0x7f8908154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f89077fe640 1 -- 172.21.15.5:0/1772269708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900009a70 con 0x7f89080b4c40 2023-11-24T07:58:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.131+0000 7f8906ffd640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 0x7f8908154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f89077fe640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f88f800c4d0 tx=0x7f88f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8005cf0 con 0x7f89080b4c40 2023-11-24T07:58:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f8005e50 con 0x7f89080b4c40 2023-11-24T07:58:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8007290 con 0x7f89080b4c40 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89080cc0d0 con 0x7f89080b4c40 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89080cba30 con 0x7f89080b4c40 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89080c6ae0 con 0x7f89080b4c40 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88f80073f0 con 0x7f89080b4c40 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 0x7f88f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88f8083080 con 0x7f89080b4c40 2023-11-24T07:58:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.135+0000 7f8906ffd640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 0x7f88f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.139+0000 7f8906ffd640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 0x7f88f4068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f89081590d0 tx=0x7f88fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.139+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88f80b4280 con 0x7f89080b4c40 2023-11-24T07:58:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.299+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f89080b55d0 con 0x7f89080b4c40 2023-11-24T07:58:39.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.303+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f89080b55d0 con 0x7f89080b4c40 2023-11-24T07:58:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.303+0000 7f88effff640 1 -- 172.21.15.5:0/1772269708 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f88f8054210 con 0x7f89080b4c40 2023-11-24T07:58:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 msgr2=0x7f88f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 0x7f88f4068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f89081590d0 tx=0x7f88fc008040 comp rx=0 tx=0).stop 2023-11-24T07:58:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 msgr2=0x7f89081539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f88f800c4d0 tx=0x7f88f800c990 comp rx=0 tx=0).stop 2023-11-24T07:58:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 shutdown_connections 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f88f4066470 0x7f88f4068930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f890815d2a0 0x7f89081547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89080d10e0 0x7f8908154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 --2- 172.21.15.5:0/1772269708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89080b4c40 0x7f89081539e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 >> 172.21.15.5:0/1772269708 conn(0x7f89080668a0 msgr2=0x7f890815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 shutdown_connections 2023-11-24T07:58:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.307+0000 7f890c92b640 1 -- 172.21.15.5:0/1772269708 wait complete. 2023-11-24T07:58:39.331 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T07:58:39.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T07:58:39.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.467+0000 7f90c16bb640 1 Processor -- start 2023-11-24T07:58:39.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.467+0000 7f90c16bb640 1 -- start start 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90c16bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 0x7f90bc06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90c16bb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc0ae300 0x7f90bc0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90c16bb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc0aeca0 con 0x7f90bc15eb50 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90c16bb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc06e7d0 con 0x7f90bc0ae300 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90c16bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc161e10 con 0x7f90bc154470 2023-11-24T07:58:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc0ae300 0x7f90bc0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90bc0ae300 0x7f90bc0ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2023-11-24T07:58:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 -- 172.21.15.5:0/1555797790 learned_addr learned my addr 172.21.15.5:0/1555797790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90baffd640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 0x7f90bc06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 -- 172.21.15.5:0/1555797790 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 msgr2=0x7f90bc06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 0x7f90bc06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 -- 172.21.15.5:0/1555797790 >> v1:172.21.15.102:6789/0 conn(0x7f90bc15eb50 legacy=0x7f90bc15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T07:58:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90ba7fc640 1 -- 172.21.15.5:0/1555797790 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc06e180 con 0x7f90bc0ae300 2023-11-24T07:58:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.471+0000 7f90baffd640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 0x7f90bc06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T07:58:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90ba7fc640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc0ae300 0x7f90bc0ae760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009870 tx=0x7f90b001cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4671a2228305e30 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90b9ffb640 1 -- 172.21.15.5:0/1555797790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00aa610 con 0x7f90bc0ae300 2023-11-24T07:58:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90b9ffb640 1 -- 172.21.15.5:0/1555797790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f90b00a6040 con 0x7f90bc0ae300 2023-11-24T07:58:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90b9ffb640 1 -- 172.21.15.5:0/1555797790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00aa9b0 con 0x7f90bc0ae300 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- 172.21.15.5:0/1555797790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc0ae300 msgr2=0x7f90bc0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc0ae300 0x7f90bc0ae760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009870 tx=0x7f90b001cf30 comp rx=0 tx=0).stop 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- 172.21.15.5:0/1555797790 shutdown_connections 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc0ae300 0x7f90bc0ae760 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 --2- 172.21.15.5:0/1555797790 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc154470 0x7f90bc06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- 172.21.15.5:0/1555797790 >> 172.21.15.5:0/1555797790 conn(0x7f90bc06a5b0 msgr2=0x7f90bc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- 172.21.15.5:0/1555797790 shutdown_connections 2023-11-24T07:58:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- 172.21.15.5:0/1555797790 wait complete. 2023-11-24T07:58:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 Processor -- start 2023-11-24T07:58:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.475+0000 7f90c16bb640 1 -- start start 2023-11-24T07:58:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 0x7f90bc14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc15eb50 0x7f90bc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc14f750 con 0x7f90bc154470 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc15c9d0 con 0x7f90bc0ae300 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc15ccb0 con 0x7f90bc15eb50 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 -- 172.21.15.5:0/2397568173 learned_addr learned my addr 172.21.15.5:0/2397568173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90baffd640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 0x7f90bc14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90bb7fe640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc15eb50 0x7f90bc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 -- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc15eb50 msgr2=0x7f90bc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc15eb50 0x7f90bc159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 -- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 msgr2=0x7f90bc14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 0x7f90bc14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 -- 172.21.15.5:0/2397568173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00094d0 con 0x7f90bc154470 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90baffd640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 0x7f90bc14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90ba7fc640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ac040 tx=0x7f90b001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00b3800 con 0x7f90bc154470 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f90b00aae90 con 0x7f90bc154470 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00b3be0 con 0x7f90bc154470 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc14fac0 con 0x7f90bc154470 2023-11-24T07:58:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc15c5f0 con 0x7f90bc154470 2023-11-24T07:58:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc0cf290 con 0x7f90bc154470 2023-11-24T07:58:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.479+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90b00b3d40 con 0x7f90bc154470 2023-11-24T07:58:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.483+0000 7f90a37fe640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:58:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.483+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f90b011e2d0 con 0x7f90bc154470 2023-11-24T07:58:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.483+0000 7f90baffd640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:58:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.483+0000 7f90baffd640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 0x7f90a8068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90ac006fd0 tx=0x7f90ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T07:58:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.487+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90b00eb9d0 con 0x7f90bc154470 2023-11-24T07:58:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90bc14f920 con 0x7f90bc154470 2023-11-24T07:58:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90a37fe640 1 -- 172.21.15.5:0/2397568173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f90bc14f920 con 0x7f90bc154470 2023-11-24T07:58:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-24T07:58:39.680 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3476908807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3476908807},{"type":"v1","addr":"172.21.15.102:6835","nonce":3476908807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4993,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1185893068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1185893068},{"type":"v1","addr":"172.21.15.102:6837","nonce":1185893068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2670405916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2670405916},{"type":"v1","addr":"172.21.15.5:6833","nonce":2670405916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5472,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3863417574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3863417574},{"type":"v1","addr":"172.21.15.5:6835","nonce":3863417574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-11-24T07:58:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2023-11-24T07:58:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 msgr2=0x7f90a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 0x7f90a8068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90ac006fd0 tx=0x7f90ac008040 comp rx=0 tx=0).stop 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 msgr2=0x7f90bc1528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f90b00ac040 tx=0x7f90b001ad10 comp rx=0 tx=0).stop 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 shutdown_connections 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:6832/2673346826,v1:172.21.15.102:6833/2673346826] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90bc15eb50 0x7f90bc159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90bc154470 0x7f90bc1528c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 --2- 172.21.15.5:0/2397568173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90bc0ae300 0x7f90bc14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T07:58:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 >> 172.21.15.5:0/2397568173 conn(0x7f90bc06a5b0 msgr2=0x7f90bc15f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T07:58:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 shutdown_connections 2023-11-24T07:58:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-24T07:58:39.675+0000 7f90c16bb640 1 -- 172.21.15.5:0/2397568173 wait complete. 2023-11-24T07:58:39.701 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T07:58:39.701 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T07:58:39.702 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T07:58:39.702 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:39.713 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T07:58:39.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T07:58:39.714 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:39.768 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T07:58:39.769 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T07:58:39.769 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:39.784 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T07:58:39.784 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T07:58:39.784 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:39.841 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T07:58:39.841 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T07:58:39.841 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T07:58:39.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:39.932 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T07:58:39.933 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T07:58:39.933 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:44.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-24T07:58:44.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:44.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:46.034 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T07:58:46.035 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T07:58:46.035 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.094 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T07:58:46.095 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T07:58:46.095 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.172 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T07:58:46.173 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T07:58:46.173 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.259 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T07:58:46.259 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T07:58:46.259 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.339 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T07:58:46.339 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T07:58:46.339 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.429 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T07:58:46.430 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T07:58:46.430 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.527 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T07:58:46.528 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T07:58:46.528 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T07:58:46.528 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.582 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T07:58:46.583 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T07:58:46.583 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.638 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T07:58:46.639 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T07:58:46.639 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T07:58:46.639 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.658 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T07:58:46.658 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T07:58:46.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.675 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T07:58:46.676 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T07:58:46.676 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T07:58:46.738 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T07:58:46.739 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T07:58:46.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T07:58:46.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:58:46.776 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T07:58:47.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:58:47.041 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T07:58:47.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:58:47.220 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T07:58:47.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:58:47.372 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T07:58:47.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:58:47.521 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T07:58:48.011 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:58:48.011 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T07:58:48.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:58:48.174 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T07:58:48.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:58:48.324 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T07:58:48.472 INFO:tasks.ceph:Archiving mon data... 2023-11-24T07:58:48.474 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/data/mon.a.tgz 2023-11-24T07:58:48.474 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2023-11-24T07:58:48.484 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.EFoAAju9tX 2023-11-24T07:58:48.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EFoAAju9tX 2023-11-24T07:58:48.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.EFoAAju9tX 2023-11-24T07:58:48.683 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.EFoAAju9tX is 278KB 2023-11-24T07:58:48.748 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.EFoAAju9tX 2023-11-24T07:58:48.757 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/data/mon.b.tgz 2023-11-24T07:58:48.757 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-11-24T07:58:48.766 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.4QFD5A3Xb3 2023-11-24T07:58:48.766 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4QFD5A3Xb3 2023-11-24T07:58:48.904 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.4QFD5A3Xb3 2023-11-24T07:58:48.979 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.4QFD5A3Xb3 is 376KB 2023-11-24T07:58:49.040 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.4QFD5A3Xb3 2023-11-24T07:58:49.049 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/data/mon.c.tgz 2023-11-24T07:58:49.049 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-11-24T07:58:49.098 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.ykGVQCz53y 2023-11-24T07:58:49.099 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ykGVQCz53y 2023-11-24T07:58:49.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.ykGVQCz53y 2023-11-24T07:58:49.311 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.ykGVQCz53y is 376KB 2023-11-24T07:58:49.372 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.ykGVQCz53y 2023-11-24T07:58:49.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-24T07:58:49.381 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T07:58:49.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T07:58:49.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T07:58:49.442 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T07:58:49.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T07:58:49.449 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T07:58:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T07:58:49.515 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T07:58:49.522 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T07:58:49.524 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi005/crash 2023-11-24T07:58:49.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T07:58:49.556 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi102/crash 2023-11-24T07:58:49.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T07:58:49.580 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T07:58:49.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:49.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:49.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:49.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T07:58:49.715 INFO:tasks.ceph:Compressing logs... 2023-11-24T07:58:49.715 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T07:58:49.741 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T07:58:49.768 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2023-11-24T07:58:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44506.log 2023-11-24T07:58:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2023-11-24T07:58:49.771 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2023-11-24T07:58:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2023-11-24T07:58:49.771 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44506.log.gz 2023-11-24T07:58:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2023-11-24T07:58:49.772 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2023-11-24T07:58:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2023-11-24T07:58:49.773 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2023-11-24T07:58:49.774 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44935.log 2023-11-24T07:58:49.774 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2023-11-24T07:58:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46822.log 2023-11-24T07:58:49.775 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2023-11-24T07:58:49.776 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44688.log 2023-11-24T07:58:49.776 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44935.log.gz 2023-11-24T07:58:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38190.log 2023-11-24T07:58:49.777 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2023-11-24T07:58:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2023-11-24T07:58:49.779 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44688.log.gz 2023-11-24T07:58:49.779 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44558.log 2023-11-24T07:58:49.780 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38190.log.gz 2023-11-24T07:58:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz -5 2023-11-24T07:58:49.780 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T07:58:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2023-11-24T07:58:49.781 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44558.log.gz 2023-11-24T07:58:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46383.log 2023-11-24T07:58:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2023-11-24T07:58:49.783 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2023-11-24T07:58:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2023-11-24T07:58:49.784 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46383.log.gz/var/log/ceph/ceph-client.admin.43700.log: 2023-11-24T07:58:49.785 INFO:teuthology.orchestra.run.smithi005.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T07:58:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44532.log 88.8% 2023-11-24T07:58:49.785 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2023-11-24T07:58:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2023-11-24T07:58:49.786 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2023-11-24T07:58:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44532.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44532.log.gz 2023-11-24T07:58:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2023-11-24T07:58:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46848.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.45670.log -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2023-11-24T07:58:49.788 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-24T07:58:49.790 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46953.log 2023-11-24T07:58:49.791 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2023-11-24T07:58:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42582.log 2023-11-24T07:58:49.791 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2023-11-24T07:58:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2023-11-24T07:58:49.792 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46953.log.gz 2023-11-24T07:58:49.792 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T07:58:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42582.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T07:58:49.793 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42582.log.gz 2023-11-24T07:58:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T07:58:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44107.log 2023-11-24T07:58:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2023-11-24T07:58:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45332.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2023-11-24T07:58:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2023-11-24T07:58:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46433.log 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2023-11-24T07:58:49.798 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46433.log.gz 2023-11-24T07:58:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44107.log.gz 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38329.log 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38329.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38329.log.gz 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38257.log 2023-11-24T07:58:49.800 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2023-11-24T07:58:49.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38353.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2023-11-24T07:58:49.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38233.log 2023-11-24T07:58:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38257.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T07:58:49.804 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2023-11-24T07:58:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2023-11-24T07:58:49.804 INFO:teuthology.orchestra.run.smithi102.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38233.log.gz 2023-11-24T07:58:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44322.log 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2023-11-24T07:58:49.806 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44454.log 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44322.log.gz 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43778.log 2023-11-24T07:58:49.807 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44454.log.gz 2023-11-24T07:58:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2023-11-24T07:58:49.811 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-11-24T07:58:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2023-11-24T07:58:49.811 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43778.log.gz 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45977.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46875.log 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2023-11-24T07:58:49.812 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46875.log.gz 2023-11-24T07:58:49.813 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38185.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44188.log 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44324.log 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T07:58:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.44188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44188.log.gz 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44324.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44324.log.gz 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38281.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44098.log 2023-11-24T07:58:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44183.log 2023-11-24T07:58:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44098.log.gz 2023-11-24T07:58:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T07:58:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.44183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44183.log.gz 2023-11-24T07:58:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43281.log 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43066.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33102.log 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2023-11-24T07:58:49.820 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43281.log.gz 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.33102.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33102.log.gz 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46057.log 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46057.log.gz 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46576.log 2023-11-24T07:58:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2023-11-24T07:58:49.822 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2023-11-24T07:58:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46576.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.46576.log.gz 2023-11-24T07:58:49.822 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2023-11-24T07:58:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 88.7% 2023-11-24T07:58:49.822 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2023-11-24T07:58:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T07:58:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.d.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T07:58:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T07:58:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T07:58:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44319.log 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42851.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46744.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz --verbose 2023-11-24T07:58:49.826 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.44270.log 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46331.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz -5 2023-11-24T07:58:49.827 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T07:58:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T07:58:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44319.log.gz 2023-11-24T07:58:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2023-11-24T07:58:49.830 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gz 2023-11-24T07:58:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43078.log 2023-11-24T07:58:49.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2023-11-24T07:58:49.830 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2023-11-24T07:58:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43078.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43078.log.gz 2023-11-24T07:58:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2023-11-24T07:58:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2023-11-24T07:58:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46119.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2023-11-24T07:58:49.833 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2023-11-24T07:58:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45592.log 2023-11-24T07:58:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47945.log 2023-11-24T07:58:49.834 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2023-11-24T07:58:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45592.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45592.log.gz 2023-11-24T07:58:49.835 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42341.log 2023-11-24T07:58:49.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2023-11-24T07:58:49.837 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47945.log.gz 2023-11-24T07:58:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42341.log.gz 2023-11-24T07:58:49.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2023-11-24T07:58:49.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2023-11-24T07:58:49.840 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2023-11-24T07:58:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44826.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2023-11-24T07:58:49.841 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2023-11-24T07:58:49.842 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2023-11-24T07:58:49.842 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2023-11-24T07:58:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47893.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2023-11-24T07:58:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47711.log 2023-11-24T07:58:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47423.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T07:58:49.844 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2023-11-24T07:58:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47711.log.gz 2023-11-24T07:58:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2023-11-24T07:58:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43282.log 2023-11-24T07:58:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47841.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2023-11-24T07:58:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44904.log 2023-11-24T07:58:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2023-11-24T07:58:49.850 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44904.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43282.log.gz 2023-11-24T07:58:49.851 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44904.log.gz 2023-11-24T07:58:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46479.log 2023-11-24T07:58:49.852 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2023-11-24T07:58:49.853 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2023-11-24T07:58:49.853 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.46479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46479.log.gz 2023-11-24T07:58:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T07:58:49.854 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44146.log 2023-11-24T07:58:49.855 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47135.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2023-11-24T07:58:49.856 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2023-11-24T07:58:49.856 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.44146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44146.log.gz 2023-11-24T07:58:49.857 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 2023-11-24T07:58:49.857 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42608.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2023-11-24T07:58:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2023-11-24T07:58:49.859 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2023-11-24T07:58:49.860 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2023-11-24T07:58:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46687.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2023-11-24T07:58:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2023-11-24T07:58:49.862 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2023-11-24T07:58:49.862 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2023-11-24T07:58:49.863 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2023-11-24T07:58:49.864 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2023-11-24T07:58:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42868.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2023-11-24T07:58:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2023-11-24T07:58:49.866 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43648.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2023-11-24T07:58:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2023-11-24T07:58:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2023-11-24T07:58:49.868 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2023-11-24T07:58:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2023-11-24T07:58:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45436.log 2023-11-24T07:58:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2023-11-24T07:58:49.871 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2023-11-24T07:58:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45436.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45436.log.gz 2023-11-24T07:58:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2023-11-24T07:58:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2023-11-24T07:58:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46713.log 2023-11-24T07:58:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2023-11-24T07:58:49.875 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2023-11-24T07:58:49.876 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T07:58:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46713.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46713.log.gz 2023-11-24T07:58:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2023-11-24T07:58:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43300.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2023-11-24T07:58:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2023-11-24T07:58:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46279.log 2023-11-24T07:58:49.879 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2023-11-24T07:58:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47284.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2023-11-24T07:58:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2023-11-24T07:58:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46279.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46279.log.gz 2023-11-24T07:58:49.882 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T07:58:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43273.log 2023-11-24T07:58:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42530.log 2023-11-24T07:58:49.884 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2023-11-24T07:58:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43273.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43273.log.gz 2023-11-24T07:58:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43830.log 2023-11-24T07:58:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42530.log.gz 2023-11-24T07:58:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2023-11-24T07:58:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2023-11-24T07:58:49.888 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43830.log.gz 2023-11-24T07:58:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47475.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2023-11-24T07:58:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47083.log 2023-11-24T07:58:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45873.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2023-11-24T07:58:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2023-11-24T07:58:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2023-11-24T07:58:49.892 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47083.log.gz 2023-11-24T07:58:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43518.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2023-11-24T07:58:49.893 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T07:58:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43596.log 2023-11-24T07:58:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43752.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2023-11-24T07:58:49.894 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2023-11-24T07:58:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43596.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43596.log.gz -5 2023-11-24T07:58:49.895 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47763.log 2023-11-24T07:58:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42448.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T07:58:49.897 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2023-11-24T07:58:49.897 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47763.log.gz 2023-11-24T07:58:49.897 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42502.log 2023-11-24T07:58:49.898 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T07:58:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44878.log 2023-11-24T07:58:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42502.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42502.log.gz 2023-11-24T07:58:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2023-11-24T07:58:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44878.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44878.log.gz 2023-11-24T07:58:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2023-11-24T07:58:49.903 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2023-11-24T07:58:49.903 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2023-11-24T07:58:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43916.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2023-11-24T07:58:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2023-11-24T07:58:49.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47527.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2023-11-24T07:58:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2023-11-24T07:58:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2023-11-24T07:58:49.907 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2023-11-24T07:58:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45702.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2023-11-24T07:58:49.908 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T07:58:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44852.log 2023-11-24T07:58:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42250.log 2023-11-24T07:58:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44852.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2023-11-24T07:58:49.910 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2023-11-24T07:58:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2023-11-24T07:58:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42250.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T07:58:49.912 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42250.log.gz 2023-11-24T07:58:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46145.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2023-11-24T07:58:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2023-11-24T07:58:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42422.log 2023-11-24T07:58:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2023-11-24T07:58:49.916 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2023-11-24T07:58:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42422.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42422.log.gz 2023-11-24T07:58:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45566.log 2023-11-24T07:58:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42217.log 2023-11-24T07:58:49.918 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2023-11-24T07:58:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45566.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45566.log.gz 2023-11-24T07:58:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2023-11-24T07:58:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2023-11-24T07:58:49.921 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42217.log.gz 2023-11-24T07:58:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47109.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2023-11-24T07:58:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43544.log 2023-11-24T07:58:49.923 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47057.log 2023-11-24T07:58:49.924 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2023-11-24T07:58:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43544.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43544.log.gz 2023-11-24T07:58:49.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46227.log 2023-11-24T07:58:49.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42861.log 2023-11-24T07:58:49.926 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2023-11-24T07:58:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46227.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46227.log.gz 2023-11-24T07:58:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44141.log 2023-11-24T07:58:49.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2023-11-24T07:58:49.928 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42861.log.gz 2023-11-24T07:58:49.929 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.44141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44141.log.gz 2023-11-24T07:58:49.931 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47310.log 2023-11-24T07:58:49.932 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42870.log 2023-11-24T07:58:49.932 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2023-11-24T07:58:49.933 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T07:58:49.933 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47310.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47310.log.gz 2023-11-24T07:58:49.933 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2023-11-24T07:58:49.934 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2023-11-24T07:58:49.934 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42870.log.gz 2023-11-24T07:58:49.935 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47685.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2023-11-24T07:58:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2023-11-24T07:58:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2023-11-24T07:58:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45821.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2023-11-24T07:58:49.938 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2023-11-24T07:58:49.938 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2023-11-24T07:58:49.939 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2023-11-24T07:58:49.939 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2023-11-24T07:58:49.940 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45384.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2023-11-24T07:58:49.941 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43056.log 2023-11-24T07:58:49.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T07:58:49.942 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2023-11-24T07:58:49.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43056.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2023-11-24T07:58:49.943 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2023-11-24T07:58:49.943 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T07:58:49.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2023-11-24T07:58:49.945 INFO:teuthology.orchestra.run.smithi005.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T07:58:49.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43570.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz 2023-11-24T07:58:49.946 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2023-11-24T07:58:49.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2023-11-24T07:58:49.947 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2023-11-24T07:58:49.948 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44296.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2023-11-24T07:58:49.948 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2023-11-24T07:58:49.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43492.log 2023-11-24T07:58:49.949 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2023-11-24T07:58:49.950 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43804.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2023-11-24T07:58:49.951 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2023-11-24T07:58:49.952 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2023-11-24T07:58:49.952 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43492.log.gz 2023-11-24T07:58:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2023-11-24T07:58:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42315.log 2023-11-24T07:58:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2023-11-24T07:58:49.955 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2023-11-24T07:58:49.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42315.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42315.log.gz 2023-11-24T07:58:49.956 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44348.log 2023-11-24T07:58:49.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2023-11-24T07:58:49.957 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2023-11-24T07:58:49.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44348.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44348.log.gz 2023-11-24T07:58:49.958 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2023-11-24T07:58:49.959 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2023-11-24T07:58:49.959 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2023-11-24T07:58:49.960 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43674.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2023-11-24T07:58:49.961 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2023-11-24T07:58:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 2023-11-24T07:58:49.962 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2023-11-24T07:58:49.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47867.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2023-11-24T07:58:49.963 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2023-11-24T07:58:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2023-11-24T07:58:49.965 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2023-11-24T07:58:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42853.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz 2023-11-24T07:58:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2023-11-24T07:58:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2023-11-24T07:58:49.967 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2023-11-24T07:58:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43270.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2023-11-24T07:58:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2023-11-24T07:58:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45925.log 2023-11-24T07:58:49.969 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2023-11-24T07:58:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2023-11-24T07:58:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46003.log 2023-11-24T07:58:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2023-11-24T07:58:49.972 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2023-11-24T07:58:49.973 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T07:58:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46003.log.gz 2023-11-24T07:58:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46357.log 2023-11-24T07:58:49.975 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T07:58:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46484.log 2023-11-24T07:58:49.975 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz 2023-11-24T07:58:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46357.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46357.log.gz 2023-11-24T07:58:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2023-11-24T07:58:49.977 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-24T07:58:49.977 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.213s 2023-11-24T07:58:49.977 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m0.796s 2023-11-24T07:58:49.977 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.121s 2023-11-24T07:58:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.46484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46484.log.gz 2023-11-24T07:58:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44039.log 2023-11-24T07:58:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 88.1% 2023-11-24T07:58:49.979 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2023-11-24T07:58:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.44039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44039.log.gz 2023-11-24T07:58:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T07:58:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2023-11-24T07:58:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T07:58:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2023-11-24T07:58:49.982 INFO:teuthology.orchestra.run.smithi005.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T07:58:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46085.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2023-11-24T07:58:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2023-11-24T07:58:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45172.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T07:58:49.985 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2023-11-24T07:58:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47997.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2023-11-24T07:58:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2023-11-24T07:58:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2023-11-24T07:58:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42396.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2023-11-24T07:58:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46524.log 2023-11-24T07:58:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2023-11-24T07:58:49.990 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2023-11-24T07:58:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46524.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46524.log.gz 2023-11-24T07:58:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2023-11-24T07:58:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2023-11-24T07:58:49.992 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2023-11-24T07:58:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45120.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2023-11-24T07:58:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2023-11-24T07:58:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2023-11-24T07:58:49.995 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2023-11-24T07:58:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42634.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2023-11-24T07:58:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2023-11-24T07:58:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2023-11-24T07:58:49.997 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2023-11-24T07:58:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44374.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2023-11-24T07:58:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44610.log 2023-11-24T07:58:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44030.log 2023-11-24T07:58:50.000 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2023-11-24T07:58:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44610.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44610.log.gz 2023-11-24T07:58:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2023-11-24T07:58:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.44030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44030.log.gz 2023-11-24T07:58:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2023-11-24T07:58:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45013.log 2023-11-24T07:58:50.005 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2023-11-24T07:58:50.005 INFO:teuthology.orchestra.run.smithi005.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T07:58:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45068.log 2023-11-24T07:58:50.006 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2023-11-24T07:58:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2023-11-24T07:58:50.007 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45013.log.gz 2023-11-24T07:58:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45068.log.gz 2023-11-24T07:58:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2023-11-24T07:58:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43258.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2023-11-24T07:58:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42474.log 2023-11-24T07:58:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2023-11-24T07:58:50.012 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2023-11-24T07:58:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42474.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42474.log.gz 2023-11-24T07:58:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45094.log 2023-11-24T07:58:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43622.log 2023-11-24T07:58:50.015 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2023-11-24T07:58:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45094.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45094.log.gz 2023-11-24T07:58:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2023-11-24T07:58:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43622.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43622.log.gz 2023-11-24T07:58:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44800.log 2023-11-24T07:58:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46770.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2023-11-24T07:58:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2023-11-24T07:58:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44800.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44800.log.gz 2023-11-24T07:58:50.021 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42858.log 2023-11-24T07:58:50.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45202.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz 2023-11-24T07:58:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45146.log 2023-11-24T07:58:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2023-11-24T07:58:50.024 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42858.log.gz 2023-11-24T07:58:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45146.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45146.log.gz 2023-11-24T07:58:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2023-11-24T07:58:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2023-11-24T07:58:50.028 INFO:teuthology.orchestra.run.smithi005.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2023-11-24T07:58:50.028 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48023.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2023-11-24T07:58:50.029 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2023-11-24T07:58:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2023-11-24T07:58:50.030 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2023-11-24T07:58:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46029.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2023-11-24T07:58:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2023-11-24T07:58:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42764.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2023-11-24T07:58:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47973.log 2023-11-24T07:58:50.034 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46305.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2023-11-24T07:58:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2023-11-24T07:58:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2023-11-24T07:58:50.037 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47973.log: /var/log/ceph/ceph-client.admin.47919.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47973.log.gz 2023-11-24T07:58:50.037 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2023-11-24T07:58:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2023-11-24T07:58:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2023-11-24T07:58:50.039 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2023-11-24T07:58:50.039 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T07:58:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44218.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2023-11-24T07:58:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2023-11-24T07:58:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44766.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2023-11-24T07:58:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44059.log 2023-11-24T07:58:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2023-11-24T07:58:50.042 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 2023-11-24T07:58:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44059.log.gz 2023-11-24T07:58:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2023-11-24T07:58:50.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43074.log 2023-11-24T07:58:50.045 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2023-11-24T07:58:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47449.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2023-11-24T07:58:50.046 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2023-11-24T07:58:50.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2023-11-24T07:58:50.047 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43074.log.gz 2023-11-24T07:58:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45462.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2023-11-24T07:58:50.048 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2023-11-24T07:58:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2023-11-24T07:58:50.050 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2023-11-24T07:58:50.050 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44961.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2023-11-24T07:58:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43466.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2023-11-24T07:58:50.052 INFO:teuthology.orchestra.run.smithi005.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T07:58:50.053 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T07:58:50.056 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-24T07:58:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.312s 2023-11-24T07:58:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m0.882s 2023-11-24T07:58:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.459s 2023-11-24T07:58:50.058 INFO:tasks.ceph:Archiving logs... 2023-11-24T07:58:50.058 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi005/log 2023-11-24T07:58:50.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T07:58:50.379 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi102/log 2023-11-24T07:58:50.379 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T07:58:50.481 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T07:58:50.492 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T07:58:50.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T07:58:50.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T07:58:50.588 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T07:58:50.598 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T07:58:50.599 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:58:50.602 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:58:50.614 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T07:58:50.614 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2023-11-24T07:58:50.614 INFO:teuthology.orchestra.run.smithi005.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 77 0.115 -3.208 1.681 2023-11-24T07:58:50.614 INFO:teuthology.orchestra.run.smithi005.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 77 0.112 +0.089 1.572 2023-11-24T07:58:50.615 INFO:teuthology.orchestra.run.smithi005.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 77 0.081 +0.585 1.625 2023-11-24T07:58:50.615 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout:*hv01.front.sepi 44.4.53.2 2 u 2 64 77 0.088 -1.806 1.392 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 77 0.067 +1.972 1.716 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 77 0.081 +0.673 1.483 2023-11-24T07:58:50.617 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:58:50.618 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T07:58:50.628 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T07:58:50.629 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T07:58:50.652 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T07:58:50.686 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T07:58:50.721 INFO:teuthology.task.internal:Duration was 870.644002 seconds 2023-11-24T07:58:50.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T07:58:50.753 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T07:58:50.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T07:58:50.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T07:58:50.836 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T07:58:50.836 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-11-24T07:58:50.837 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T07:58:50.859 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2023-11-24T07:58:50.859 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T07:58:50.880 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T07:58:50.880 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T07:58:50.909 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T07:58:50.959 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T07:58:50.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T07:58:50.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T07:58:51.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T07:58:51.082 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T07:58:51.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T07:58:51.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T07:58:51.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T07:58:51.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T07:58:51.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T07:58:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-11-24T07:58:51.184 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2023-11-24T07:58:51.202 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T07:58:51.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:51.238 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T07:58:51.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:58:51.254 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T07:58:51.267 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T07:58:51.268 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi005 2023-11-24T07:58:51.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T07:58:51.307 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573/remote/smithi102 2023-11-24T07:58:51.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T07:58:51.331 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T07:58:51.331 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T07:58:51.349 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T07:58:51.382 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T07:58:51.396 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T07:58:51.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T07:58:51.431 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T07:58:51.431 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T07:58:51.434 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T07:58:51.440 INFO:teuthology.orchestra.run.smithi005.stdout: 658041 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 07:58 /home/ubuntu/cephtest 2023-11-24T07:58:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: 658040 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 07:58 /home/ubuntu/cephtest 2023-11-24T07:58:51.445 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T07:58:51.464 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T07:58:51.533 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T07:58:51.560 DEBUG:teuthology.nuke:shortname: smithi005 2023-11-24T07:58:51.560 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:58:51.584 DEBUG:teuthology.nuke:shortname: smithi102 2023-11-24T07:58:51.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:58:51.588 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:34:22.809863', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLk25BrYH4aQahsIF9eRisRqqxeyQXg8VD0LKT7euYG+DBina54QY7n6YjIO4Eeu6Go1a6VzbLED3+HUxruhOtY='} 2023-11-24T07:58:51.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:34:22.807986', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRw3/2AEIHJrlQoY1v1avzQ5H0ybWQyPKnF8iK3xe+K/iVs+bqRajUC2gVaUzdjwhhWuLNDumtZgkxeiT7YbY8='} 2023-11-24T07:58:51.636 INFO:teuthology.orchestra.console.smithi005:Power off 2023-11-24T07:58:51.637 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T07:58:51.663 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-11-24T07:58:51.663 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:51.679 INFO:teuthology.orchestra.console.smithi102:Power off 2023-11-24T07:58:51.680 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T07:58:51.692 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-24T07:58:51.705 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-11-24T07:58:51.705 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:51.729 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-11-24T07:58:55.694 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:55.729 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:55.805 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-24T07:58:55.841 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-11-24T07:58:59.807 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:59.842 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:58:59.919 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-24T07:58:59.953 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-11-24T07:59:00.053 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-11-24T07:59:03.922 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T07:59:04.035 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-24T07:59:04.135 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-11-24T07:59:04.241 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} duration: 870.6440024375916 failure_reason: 'Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=53c6726510b444238ae44e92ebec6d2a status: fail success: false 2023-11-24T07:59:04.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:59:04.331 INFO:teuthology.run:FAIL